Jul 21 18:30:12.380453 ip-10-0-137-12 systemd[1]: Starting Kubernetes Kubelet... Jul 21 18:30:12.751516 ip-10-0-137-12 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:30:12.751516 ip-10-0-137-12 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 18:30:12.751516 ip-10-0-137-12 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:30:12.751516 ip-10-0-137-12 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 18:30:12.751516 ip-10-0-137-12 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 18:30:12.752304 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.752185 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 18:30:12.757248 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757232 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:12.757248 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757248 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757251 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757255 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757258 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757263 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757267 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757270 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757273 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757276 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757278 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757281 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757284 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757286 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757289 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757291 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757294 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757302 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757305 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757309 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:12.757326 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757313 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757316 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757319 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757322 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757325 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757328 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757331 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757334 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757337 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757340 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757343 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757346 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757349 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757351 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757354 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757357 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757360 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757362 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757365 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757367 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:12.757775 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757370 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757372 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757376 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757378 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757380 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757383 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757385 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757388 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757390 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757392 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757395 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757398 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757400 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757402 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757407 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757409 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757412 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757414 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757417 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:12.758272 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757420 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757422 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757424 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757427 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757429 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757431 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757434 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757436 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757441 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757444 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757447 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757450 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757453 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757456 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757459 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757461 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757464 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757466 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757469 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757471 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:12.758726 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757473 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757476 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757478 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757481 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757483 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757486 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757488 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757491 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757494 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757496 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757499 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757502 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757504 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757506 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757509 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757511 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757514 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757516 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757518 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.757521 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:12.759218 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758248 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758254 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758258 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758260 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758263 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758266 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758269 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758272 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758275 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758278 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758280 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758283 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758286 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758288 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758291 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758294 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758296 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758299 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758301 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758304 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:12.759706 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758306 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758309 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758311 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758314 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758317 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758319 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758322 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758324 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758327 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758329 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758332 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758334 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758337 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758339 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758341 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758344 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758346 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758348 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758352 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758354 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:12.760221 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758357 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758359 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758362 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758365 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758367 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758370 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758372 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758375 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758378 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758380 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758383 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758385 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758387 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758390 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758393 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758395 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758399 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758403 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758407 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758409 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:12.760710 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758412 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758415 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758418 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758422 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758425 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758428 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758431 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758434 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758437 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758440 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758443 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758446 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758449 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758452 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758454 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758460 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758463 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758466 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758469 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:12.761217 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758471 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758474 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758476 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758480 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758483 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758486 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758489 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758491 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758493 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758496 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758498 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758501 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758504 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758506 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758508 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758511 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758513 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758516 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758518 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758520 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:12.761684 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758905 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758910 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758913 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758916 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758919 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758922 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758925 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758927 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758931 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758934 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758936 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758939 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758942 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758944 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758947 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758949 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758952 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758954 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758956 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:12.762204 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758959 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758962 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758964 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758966 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758969 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758972 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758974 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758977 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758979 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758982 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758984 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758988 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.758992 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759000 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759003 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759006 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759009 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759011 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759014 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:12.762652 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759017 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759019 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759023 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759025 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759028 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759030 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759033 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759035 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759038 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759041 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759044 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759046 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759048 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759052 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759056 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759058 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759061 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759065 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759068 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:12.763108 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759070 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759073 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759076 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759079 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759081 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759084 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759086 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759090 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759092 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759096 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759099 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759101 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759104 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759106 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759109 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759127 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759130 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759133 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759135 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759138 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:12.763623 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759142 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759144 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759147 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759149 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759152 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759154 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759157 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759159 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759162 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759164 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759167 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759169 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759171 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759174 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759176 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759179 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759181 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759183 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759186 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759189 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:12.764254 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759192 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759195 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759268 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759275 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759282 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759287 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759292 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759297 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759301 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759305 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759309 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759311 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759315 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759318 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759321 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759324 2565 flags.go:64] FLAG: --cgroup-root="" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759327 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759330 2565 flags.go:64] FLAG: --client-ca-file="" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759332 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759335 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759339 2565 flags.go:64] FLAG: --cluster-domain="" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759342 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759345 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759348 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 18:30:12.764748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759351 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759355 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759358 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759361 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759364 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759367 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759369 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759373 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759377 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759379 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759384 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759387 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759390 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759393 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759404 2565 flags.go:64] FLAG: --enable-server="true" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759411 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759421 2565 flags.go:64] FLAG: --event-burst="100" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759424 2565 flags.go:64] FLAG: --event-qps="50" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759427 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759430 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759433 2565 flags.go:64] FLAG: --eviction-hard="" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759437 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759440 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759443 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759445 2565 flags.go:64] FLAG: --eviction-soft="" Jul 21 18:30:12.765399 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759448 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759451 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759453 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759456 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759459 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759461 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759464 2565 flags.go:64] FLAG: --feature-gates="" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759468 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759471 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759474 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759477 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759479 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759482 2565 flags.go:64] FLAG: --help="false" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759485 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-12.ec2.internal" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759489 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759492 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759494 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759498 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759501 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759503 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759506 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759508 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759512 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 18:30:12.766009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759516 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759519 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759522 2565 flags.go:64] FLAG: --kube-reserved="" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759524 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759527 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759530 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759533 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759535 2565 flags.go:64] FLAG: --lock-file="" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759538 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759541 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759544 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759549 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759552 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759554 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759557 2565 flags.go:64] FLAG: --logging-format="text" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759560 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759563 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759565 2565 flags.go:64] FLAG: --manifest-url="" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759568 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759572 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759575 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759579 2565 flags.go:64] FLAG: --max-pods="110" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759582 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759586 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759589 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 18:30:12.766618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759592 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759595 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759597 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759600 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759607 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759609 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759614 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759617 2565 flags.go:64] FLAG: --pod-cidr="" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759620 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759625 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759627 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759630 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759633 2565 flags.go:64] FLAG: --port="10250" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759636 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759639 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e2c545f73822fe6" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759642 2565 flags.go:64] FLAG: --qos-reserved="" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759645 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759648 2565 flags.go:64] FLAG: --register-node="true" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759651 2565 flags.go:64] FLAG: --register-with-taints="" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759654 2565 flags.go:64] FLAG: --registry-burst="10" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759657 2565 flags.go:64] FLAG: --registry-qps="5" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759660 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759662 2565 flags.go:64] FLAG: --reserved-memory="" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759666 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759669 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 18:30:12.767238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759672 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759674 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759677 2565 flags.go:64] FLAG: --runonce="false" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759679 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759682 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759687 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759689 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759692 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759695 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759698 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759701 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759704 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759707 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759709 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759714 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759717 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759720 2565 flags.go:64] FLAG: --system-cgroups="" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759723 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759728 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759731 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759734 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759738 2565 flags.go:64] FLAG: --tls-min-version="" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759740 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759743 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759746 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 18:30:12.767865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759749 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759752 2565 flags.go:64] FLAG: --v="2" Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759756 2565 flags.go:64] FLAG: --version="false" Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759759 2565 flags.go:64] FLAG: --vmodule="" Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759763 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.759766 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759879 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759882 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759885 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759889 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759891 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759894 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759898 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759901 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759903 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759906 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759908 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759911 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759913 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759915 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759918 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759922 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:12.768532 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759925 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759927 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759930 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759933 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759935 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759937 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759940 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759942 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759945 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759947 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759949 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759952 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759954 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759956 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759959 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759961 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759964 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759966 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759968 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759970 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:12.769066 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759973 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759975 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759979 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759982 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759984 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759987 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759989 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759991 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759994 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759996 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.759998 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760002 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760005 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760007 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760010 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760012 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760015 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760017 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760020 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760022 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:12.769564 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760025 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760027 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760030 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760032 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760035 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760037 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760039 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760042 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760044 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760047 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760049 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760051 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760054 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760056 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760061 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760064 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760067 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760070 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760072 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:12.770054 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760075 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760077 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760080 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760082 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760086 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760088 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760092 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760095 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760097 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760100 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760103 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760105 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760108 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760124 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760127 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760130 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760132 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760135 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760139 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:12.770528 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760142 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760145 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760149 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760151 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.760154 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.760163 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.767195 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.767210 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.767227 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.767236 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767290 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767295 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767299 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767302 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767304 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:12.770985 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767307 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767309 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767312 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767315 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767318 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767321 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767323 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767327 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767330 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767333 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767335 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767338 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767340 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767343 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767346 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767349 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767351 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767354 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767356 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767359 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:12.771382 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767362 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767370 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767372 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767375 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767378 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767381 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767384 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767387 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767392 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767404 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767408 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767411 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767414 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767417 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767420 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767423 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767426 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767428 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767431 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:12.771917 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767433 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767437 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767440 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767442 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767445 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767447 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767450 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767452 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767455 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767457 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767460 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767462 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767465 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767467 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767470 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767472 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767474 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767478 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767481 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767484 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:12.772404 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767486 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767488 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767491 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767493 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767496 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767498 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767500 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767503 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767505 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767507 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767510 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767513 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767515 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767518 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767522 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767526 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767529 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767532 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767535 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:12.772883 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767537 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767540 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767542 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767545 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767547 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767549 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767552 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767554 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767557 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767559 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767562 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767565 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767567 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767570 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767573 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:12.773441 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767575 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.767580 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767696 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767701 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767705 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767708 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767711 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767715 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767717 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767720 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767724 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767727 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767731 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767735 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 18:30:12.773800 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767738 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767741 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767743 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767746 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767748 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767751 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767753 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767755 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767758 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767760 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767763 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767765 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767767 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767770 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767773 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767775 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767778 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767780 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767783 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767785 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 18:30:12.774157 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767787 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767790 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767792 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767795 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767797 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767799 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767802 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767804 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767806 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767808 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767811 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767813 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767816 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767819 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767821 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767823 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767826 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767828 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767831 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 18:30:12.774644 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767833 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767835 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767837 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767840 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767842 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767845 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767847 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767850 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767852 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767855 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767857 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767859 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767862 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767864 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767866 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767869 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767871 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767874 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767877 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767879 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 18:30:12.775094 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767882 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767885 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767887 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767889 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767892 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767894 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767897 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767899 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767902 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767904 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767907 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767909 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767912 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767914 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767917 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767919 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767922 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767924 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767926 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767929 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 18:30:12.775752 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767931 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767933 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767935 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767938 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767940 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767942 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767945 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:12.767947 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.767952 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.768057 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.770658 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.772037 2565 server.go:1019] "Starting client certificate rotation" Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.772143 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 18:30:12.776263 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.772179 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 18:30:12.776619 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.774480 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 18:30:12.779468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.779446 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 18:30:12.788879 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.788858 2565 log.go:25] "Validated CRI v1 runtime API" Jul 21 18:30:12.791242 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.791222 2565 log.go:25] "Validated CRI v1 image API" Jul 21 18:30:12.792737 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.792724 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 18:30:12.794964 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.794940 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 80dbdef0-d9e9-4c1e-b763-89d66dc469ed:/dev/nvme0n1p3 b88f698c-d208-49e3-b895-cbde56fce010:/dev/nvme0n1p4] Jul 21 18:30:12.795055 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.794962 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 18:30:12.800585 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.800452 2565 manager.go:216] Machine: {Timestamp:2026-07-21 18:30:12.798778241 +0000 UTC m=+0.307389959 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100397 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21ff8a2b7735ada7ab5d032a6dde6b SystemUUID:ec21ff8a-2b77-35ad-a7ab-5d032a6dde6b BootID:8d60c0b8-0950-4f40-9ae0-607ff826ea37 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:88:d6:ee:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:88:d6:ee:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:bf:78:db:3f:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 18:30:12.800585 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.800572 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 18:30:12.800792 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.800708 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 18:30:12.803721 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.803699 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 18:30:12.803831 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.803791 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 18:30:12.804003 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.803847 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 18:30:12.805205 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.805191 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 18:30:12.805277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.805210 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 18:30:12.805277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.805221 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 18:30:12.805277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.805241 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 18:30:12.806850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.806835 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 18:30:12.811248 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811231 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 21 18:30:12.811417 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811404 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 18:30:12.811484 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811446 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 21 18:30:12.811484 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811471 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 18:30:12.811577 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811493 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 18:30:12.811577 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811507 2565 kubelet.go:398] "Adding apiserver pod source" Jul 21 18:30:12.811577 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811541 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 18:30:12.811962 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811925 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 18:30:12.811962 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.811961 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 18:30:12.814161 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.814135 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 18:30:12.816381 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.816367 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 18:30:12.816425 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.816400 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 18:30:12.817695 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817680 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 18:30:12.817752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817698 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 18:30:12.817752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817708 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 18:30:12.817752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817716 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 18:30:12.817752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817731 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 18:30:12.817752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817741 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 18:30:12.817752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817754 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 18:30:12.817967 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817762 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 18:30:12.817967 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817772 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 18:30:12.817967 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817780 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 18:30:12.817967 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817803 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 18:30:12.817967 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.817812 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 18:30:12.819386 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.819369 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 18:30:12.819653 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.819609 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 18:30:12.823674 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.823656 2565 server.go:1268] "Started kubelet" Jul 21 18:30:12.823793 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.823747 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 18:30:12.823856 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.823808 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 18:30:12.823930 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.823872 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 18:30:12.824219 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.824199 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 18:30:12.824219 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.824205 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 18:30:12.824346 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.824298 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 18:30:12.825425 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.825405 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 21 18:30:12.825512 ip-10-0-137-12 systemd[1]: Started Kubernetes Kubelet. Jul 21 18:30:12.825654 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.825639 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 18:30:12.828577 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.828554 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 18:30:12.832787 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.831916 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-12.ec2.internal.18c4618d86b177fd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-12.ec2.internal,UID:ip-10-0-137-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-12.ec2.internal,},FirstTimestamp:2026-07-21 18:30:12.823619581 +0000 UTC m=+0.332231298,LastTimestamp:2026-07-21 18:30:12.823619581 +0000 UTC m=+0.332231298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-12.ec2.internal,}" Jul 21 18:30:12.836480 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.836455 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 18:30:12.836480 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.836466 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 18:30:12.836643 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.836535 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:12.837148 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837109 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 18:30:12.837243 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837105 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 18:30:12.837243 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837165 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 18:30:12.837344 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837274 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 21 18:30:12.837344 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837283 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 21 18:30:12.837418 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837350 2565 factory.go:55] Registering systemd factory Jul 21 18:30:12.837418 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837366 2565 factory.go:223] Registration of the systemd container factory successfully Jul 21 18:30:12.837581 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837563 2565 factory.go:153] Registering CRI-O factory Jul 21 18:30:12.837581 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837574 2565 factory.go:223] Registration of the crio container factory successfully Jul 21 18:30:12.837689 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837626 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 18:30:12.837689 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837654 2565 factory.go:103] Registering Raw factory Jul 21 18:30:12.837689 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.837667 2565 manager.go:1196] Started watching for new ooms in manager Jul 21 18:30:12.838163 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.838146 2565 manager.go:349] Starting recovery of all containers Jul 21 18:30:12.839295 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.839265 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 18:30:12.839494 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.839434 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 18:30:12.850542 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.850518 2565 manager.go:354] Recovery completed Jul 21 18:30:12.856214 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.856192 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:12.858204 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858177 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:12.858279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858218 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:12.858279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858229 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:12.858765 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858747 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 18:30:12.858765 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858763 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 18:30:12.858903 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858780 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:12.858903 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.858783 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 21 18:30:12.859652 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.859555 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:12.859708 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.859693 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:12.859738 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.859707 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:12.861135 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.861106 2565 policy_none.go:49] "None policy: Start" Jul 21 18:30:12.861135 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.861138 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 18:30:12.861265 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.861149 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 18:30:12.863191 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.863180 2565 policy_none.go:47] "Start" Jul 21 18:30:12.869531 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.869319 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-12.ec2.internal.18c4618d88c132f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-12.ec2.internal,UID:ip-10-0-137-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-12.ec2.internal,},FirstTimestamp:2026-07-21 18:30:12.858204912 +0000 UTC m=+0.366816633,LastTimestamp:2026-07-21 18:30:12.858204912 +0000 UTC m=+0.366816633,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-12.ec2.internal,}" Jul 21 18:30:12.878542 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.878513 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bh8g2" Jul 21 18:30:12.880273 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.880209 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-12.ec2.internal.18c4618d88c17b5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-12.ec2.internal,UID:ip-10-0-137-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-12.ec2.internal,},FirstTimestamp:2026-07-21 18:30:12.858223453 +0000 UTC m=+0.366835171,LastTimestamp:2026-07-21 18:30:12.858223453 +0000 UTC m=+0.366835171,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-12.ec2.internal,}" Jul 21 18:30:12.885841 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.885810 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bh8g2" Jul 21 18:30:12.890974 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.890887 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-12.ec2.internal.18c4618d88c19ff2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-12.ec2.internal,UID:ip-10-0-137-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-12.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-12.ec2.internal,},FirstTimestamp:2026-07-21 18:30:12.858232818 +0000 UTC m=+0.366844536,LastTimestamp:2026-07-21 18:30:12.858232818 +0000 UTC m=+0.366844536,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-12.ec2.internal,}" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.897787 2565 manager.go:337] "Starting Device Plugin manager" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.897817 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.897826 2565 server.go:87] "Starting device plugin registration server" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.898095 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.898129 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.898237 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.898322 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.898329 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.899018 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 18:30:12.915200 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.899081 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:12.975178 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.975141 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 18:30:12.976485 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.976467 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 18:30:12.976546 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.976512 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 18:30:12.976546 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.976533 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 18:30:12.976622 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:12.976569 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 18:30:12.979539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.979515 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:12.998931 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.998906 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:12.999863 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.999847 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:12.999941 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.999877 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:12.999941 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.999887 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:12.999941 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:12.999914 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.015172 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.015078 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.015172 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.015130 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-12.ec2.internal\": node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.077158 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.077081 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal"] Jul 21 18:30:13.077296 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.077197 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:13.078517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.078501 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:13.078592 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.078535 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:13.078592 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.078549 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:13.081169 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.081156 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:13.081224 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.081211 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.081283 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.081240 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:13.081875 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.081861 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:13.081926 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.081888 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:13.081926 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.081897 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:13.082447 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.082430 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:13.082535 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.082458 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:13.082535 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.082468 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:13.084854 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.084840 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.084902 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.084876 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 18:30:13.085658 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.085643 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientMemory" Jul 21 18:30:13.085723 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.085670 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 18:30:13.085723 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.085683 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeHasSufficientPID" Jul 21 18:30:13.113996 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.113970 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-12.ec2.internal\" not found" node="ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.118648 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.118630 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-12.ec2.internal\" not found" node="ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.127929 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.127905 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.146952 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.146915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b34d0b12dcb6af4c4556337d9f29d266-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal\" (UID: \"b34d0b12dcb6af4c4556337d9f29d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.146952 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.146954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b34d0b12dcb6af4c4556337d9f29d266-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal\" (UID: \"b34d0b12dcb6af4c4556337d9f29d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.147098 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.146972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4f721e547e13bf17c3613886dc1af5b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-12.ec2.internal\" (UID: \"f4f721e547e13bf17c3613886dc1af5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.228556 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.228522 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.248110 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.248084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b34d0b12dcb6af4c4556337d9f29d266-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal\" (UID: \"b34d0b12dcb6af4c4556337d9f29d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.248197 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.248127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b34d0b12dcb6af4c4556337d9f29d266-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal\" (UID: \"b34d0b12dcb6af4c4556337d9f29d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.248197 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.248144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4f721e547e13bf17c3613886dc1af5b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-12.ec2.internal\" (UID: \"f4f721e547e13bf17c3613886dc1af5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.248197 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.248181 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b34d0b12dcb6af4c4556337d9f29d266-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal\" (UID: \"b34d0b12dcb6af4c4556337d9f29d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.248299 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.248191 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b34d0b12dcb6af4c4556337d9f29d266-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal\" (UID: \"b34d0b12dcb6af4c4556337d9f29d266\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.248299 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.248215 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4f721e547e13bf17c3613886dc1af5b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-12.ec2.internal\" (UID: \"f4f721e547e13bf17c3613886dc1af5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.328723 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.328644 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.418283 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.418249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.422007 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.421989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.429780 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.429756 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.530394 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.530350 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.630958 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.630875 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.731547 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.731513 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.772037 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.771985 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 18:30:13.772522 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.772175 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 18:30:13.831981 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:13.831947 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-12.ec2.internal\" not found" Jul 21 18:30:13.863095 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.863069 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:13.891611 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.891533 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 18:25:14 +0000 UTC" deadline="2028-02-11 09:47:40.57841744 +0000 UTC" Jul 21 18:30:13.891611 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.891569 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13671h17m26.68685394s" Jul 21 18:30:13.937034 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.937008 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.952825 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.952800 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 18:30:13.954629 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.954609 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" Jul 21 18:30:13.962599 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.962573 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 18:30:13.972215 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:13.972187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f721e547e13bf17c3613886dc1af5b.slice/crio-5239e34b1f42c6f8d2b5332a48ee4ca740fea29233c4e7ff046fc92af168b454 WatchSource:0}: Error finding container 5239e34b1f42c6f8d2b5332a48ee4ca740fea29233c4e7ff046fc92af168b454: Status 404 returned error can't find the container with id 5239e34b1f42c6f8d2b5332a48ee4ca740fea29233c4e7ff046fc92af168b454 Jul 21 18:30:13.972375 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:13.972357 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34d0b12dcb6af4c4556337d9f29d266.slice/crio-91e51972bdad5a4a1d3caab026a07404c90a2780464039819d9426d4af42f4a4 WatchSource:0}: Error finding container 91e51972bdad5a4a1d3caab026a07404c90a2780464039819d9426d4af42f4a4: Status 404 returned error can't find the container with id 91e51972bdad5a4a1d3caab026a07404c90a2780464039819d9426d4af42f4a4 Jul 21 18:30:13.977764 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.977749 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:30:13.982177 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.982103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" event={"ID":"f4f721e547e13bf17c3613886dc1af5b","Type":"ContainerStarted","Data":"5239e34b1f42c6f8d2b5332a48ee4ca740fea29233c4e7ff046fc92af168b454"} Jul 21 18:30:13.983133 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:13.983093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" event={"ID":"b34d0b12dcb6af4c4556337d9f29d266","Type":"ContainerStarted","Data":"91e51972bdad5a4a1d3caab026a07404c90a2780464039819d9426d4af42f4a4"} Jul 21 18:30:14.206594 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:14.206509 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:14.405191 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:14.405161 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:16.387857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.387531 2565 apiserver.go:52] "Watching apiserver" Jul 21 18:30:16.395835 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.395805 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 18:30:16.396431 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.396408 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zfx75","openshift-network-diagnostics/network-check-target-2656j","kube-system/global-pull-secret-syncer-6d7dw","kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl","openshift-multus/multus-additional-cni-plugins-fps6j","openshift-network-operator/iptables-alerter-jcmsn","openshift-ovn-kubernetes/ovnkube-node-mcnjr","kube-system/konnectivity-agent-9qdx6","openshift-cluster-node-tuning-operator/tuned-8kbkt","openshift-dns/node-resolver-vd2z9","openshift-image-registry/node-ca-dm9tm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal","openshift-multus/multus-dxr8r"] Jul 21 18:30:16.399109 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.399066 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.401517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.401492 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:16.401642 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.401575 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:16.402024 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.402005 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7nh69\"" Jul 21 18:30:16.402338 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.402319 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.402573 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.402552 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.404354 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.404333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.406778 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.406740 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.407693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.407660 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 18:30:16.407693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.407700 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bhj8f\"" Jul 21 18:30:16.407976 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.407959 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 18:30:16.408324 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.408276 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.408324 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.408308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.410023 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.410001 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.412196 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.412174 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 18:30:16.412295 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.412251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.414471 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.414451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:16.414581 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.414533 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:16.415362 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.415342 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.415526 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.415509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.416129 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dtxbb\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.416273 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.416383 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.416939 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.417217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rpql9\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.417376 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.417557 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.417783 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-df7wn\"" Jul 21 18:30:16.418123 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.417838 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.421557 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.421414 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.423771 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.423752 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.426151 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.426130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.426521 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.426499 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 18:30:16.426614 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.426508 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qpfcz\"" Jul 21 18:30:16.426839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.426823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 18:30:16.427019 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.426994 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.427266 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.427231 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bb8bv\"" Jul 21 18:30:16.427364 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.427292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 18:30:16.427541 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.427499 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.427617 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.427556 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 18:30:16.427667 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.427641 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 18:30:16.427904 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.427852 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 18:30:16.428493 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.428291 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.428904 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.428885 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.429894 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.429849 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b8l8r\"" Jul 21 18:30:16.430141 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.429914 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 18:30:16.430355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.430336 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbpk\" (UniqueName: \"kubernetes.io/projected/f86889d0-703b-43e8-b66e-5fe7a3632535-kube-api-access-9fbpk\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-multus-certs\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432432 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-sys-fs\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-netns\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-cni-bin\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6vlj\" (UniqueName: \"kubernetes.io/projected/95748c1a-496b-46c0-9d7f-eac96cafda55-kube-api-access-r6vlj\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.432693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-kubelet\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgz24\" (UniqueName: \"kubernetes.io/projected/63b6f525-5045-42af-bba6-e33a7ab072b1-kube-api-access-vgz24\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-socket-dir-parent\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432783 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-cni-multus\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95748c1a-496b-46c0-9d7f-eac96cafda55-serviceca\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432825 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-socket-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.432893 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-device-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.432993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-cnibin\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-hostroot\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfm2x\" (UniqueName: \"kubernetes.io/projected/1a719967-78cc-4376-9ecb-b49d3f01c66b-kube-api-access-dfm2x\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.433202 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-system-cni-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-conf-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbqr\" (UniqueName: \"kubernetes.io/projected/25cd6f50-f464-49ae-a833-6eafeb473291-kube-api-access-kjbqr\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86889d0-703b-43e8-b66e-5fe7a3632535-tmp-dir\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433239 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-cnibin\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-os-release\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a417814d-d92e-4dd2-92a6-8d311ee9542a-cni-binary-copy\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-etc-kubernetes\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq97d\" (UniqueName: \"kubernetes.io/projected/a417814d-d92e-4dd2-92a6-8d311ee9542a-kube-api-access-sq97d\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-system-cni-dir\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f86889d0-703b-43e8-b66e-5fe7a3632535-hosts-file\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-cni-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-k8s-cni-cncf-io\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-daemon-config\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95748c1a-496b-46c0-9d7f-eac96cafda55-host\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-registration-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.433943 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:16.434806 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.433656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-os-release\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.435312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.435271 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58vfj\"" Jul 21 18:30:16.435455 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.435430 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:16.436140 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.436119 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:16.441642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.441619 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 18:30:16.467204 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.467180 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5k2zp" Jul 21 18:30:16.481950 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.481924 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5k2zp" Jul 21 18:30:16.513405 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.513372 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 18:30:16.533944 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.533889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:16.533944 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.533923 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-systemd\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.533944 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.533944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-var-lib-kubelet\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.534236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.533966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-tuned\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.534236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.533994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.534236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.534018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-netns\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.534236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.534127 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-netns\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.534236 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.534158 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:16.534236 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.534232 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:17.034209619 +0000 UTC m=+2.967848006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:16.534564 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.534165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6vlj\" (UniqueName: \"kubernetes.io/projected/95748c1a-496b-46c0-9d7f-eac96cafda55-kube-api-access-r6vlj\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.534564 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.534282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8thm\" (UniqueName: \"kubernetes.io/projected/37763de9-2cdc-4747-97ab-97c4e02e0dd3-kube-api-access-l8thm\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.534564 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.534320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-etc-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-cni-netd\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-iptables-alerter-script\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgz24\" (UniqueName: \"kubernetes.io/projected/63b6f525-5045-42af-bba6-e33a7ab072b1-kube-api-access-vgz24\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-socket-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37763de9-2cdc-4747-97ab-97c4e02e0dd3-tmp\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.535523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535471 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8adeed6a-2187-4327-a504-413c342e1ea6-konnectivity-ca\") pod \"konnectivity-agent-9qdx6\" (UID: \"8adeed6a-2187-4327-a504-413c342e1ea6\") " pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535604 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-socket-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-host-slash\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-log-socket\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-hostroot\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.535984 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-sys\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.536016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-systemd-units\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.536504 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.536504 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536406 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.536504 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536492 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-hostroot\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.536633 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-conf-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.536633 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536580 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-conf-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.536724 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.536724 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-cni-bin\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.536724 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536717 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovn-node-metrics-cert\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.536844 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn2kt\" (UniqueName: \"kubernetes.io/projected/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-kube-api-access-wn2kt\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.536844 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-cnibin\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.536932 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq97d\" (UniqueName: \"kubernetes.io/projected/a417814d-d92e-4dd2-92a6-8d311ee9542a-kube-api-access-sq97d\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.536932 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysctl-conf\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.537023 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-system-cni-dir\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.537023 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.536961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-k8s-cni-cncf-io\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.537128 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537029 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63b6f525-5045-42af-bba6-e33a7ab072b1-cni-binary-copy\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.537181 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-registration-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537227 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-cnibin\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537283 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-system-cni-dir\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537342 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-k8s-cni-cncf-io\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-registration-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537462 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-sys-fs\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-modprobe-d\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-var-lib-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537623 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbpk\" (UniqueName: \"kubernetes.io/projected/f86889d0-703b-43e8-b66e-5fe7a3632535-kube-api-access-9fbpk\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-multus-certs\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-sys-fs\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysctl-d\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537756 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-run-multus-certs\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-dbus\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.538701 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-slash\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-cni-bin\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-run\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.537998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-kubelet-config\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-ovn\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-env-overrides\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-kubernetes\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-kubelet\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-socket-dir-parent\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538289 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-cni-bin\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-cni-multus\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95748c1a-496b-46c0-9d7f-eac96cafda55-serviceca\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-cni-multus\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-run-netns\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-host-var-lib-kubelet\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-device-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.539501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538764 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-socket-dir-parent\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538806 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a719967-78cc-4376-9ecb-b49d3f01c66b-device-dir\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-cnibin\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfm2x\" (UniqueName: \"kubernetes.io/projected/1a719967-78cc-4376-9ecb-b49d3f01c66b-kube-api-access-dfm2x\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538961 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-cnibin\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.538996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-lib-modules\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539019 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95748c1a-496b-46c0-9d7f-eac96cafda55-serviceca\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-system-cni-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbqr\" (UniqueName: \"kubernetes.io/projected/25cd6f50-f464-49ae-a833-6eafeb473291-kube-api-access-kjbqr\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539179 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-system-cni-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-kubelet\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovnkube-script-lib\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539264 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhrc\" (UniqueName: \"kubernetes.io/projected/342dd22f-6aa0-442e-b0f6-291a497a49ae-kube-api-access-ghhrc\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86889d0-703b-43e8-b66e-5fe7a3632535-tmp-dir\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.540040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-os-release\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539458 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-os-release\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a417814d-d92e-4dd2-92a6-8d311ee9542a-cni-binary-copy\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-etc-kubernetes\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-host\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539603 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovnkube-config\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysconfig\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86889d0-703b-43e8-b66e-5fe7a3632535-tmp-dir\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f86889d0-703b-43e8-b66e-5fe7a3632535-hosts-file\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-cni-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f86889d0-703b-43e8-b66e-5fe7a3632535-hosts-file\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-cni-dir\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-daemon-config\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95748c1a-496b-46c0-9d7f-eac96cafda55-host\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.539975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-systemd\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540033 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a417814d-d92e-4dd2-92a6-8d311ee9542a-etc-kubernetes\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-node-log\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8adeed6a-2187-4327-a504-413c342e1ea6-agent-certs\") pod \"konnectivity-agent-9qdx6\" (UID: \"8adeed6a-2187-4327-a504-413c342e1ea6\") " pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.540640 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540217 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-os-release\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.541252 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/63b6f525-5045-42af-bba6-e33a7ab072b1-os-release\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.541252 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540450 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a417814d-d92e-4dd2-92a6-8d311ee9542a-multus-daemon-config\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.541252 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95748c1a-496b-46c0-9d7f-eac96cafda55-host\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.541252 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.540602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a417814d-d92e-4dd2-92a6-8d311ee9542a-cni-binary-copy\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.544826 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.544800 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 18:30:16.547640 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.547618 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:16.547762 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.547645 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:16.547762 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.547656 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:16.547762 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.547708 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:17.047692477 +0000 UTC m=+2.981330866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:16.548686 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.548655 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgz24\" (UniqueName: \"kubernetes.io/projected/63b6f525-5045-42af-bba6-e33a7ab072b1-kube-api-access-vgz24\") pod \"multus-additional-cni-plugins-fps6j\" (UID: \"63b6f525-5045-42af-bba6-e33a7ab072b1\") " pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.548787 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.548680 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbpk\" (UniqueName: \"kubernetes.io/projected/f86889d0-703b-43e8-b66e-5fe7a3632535-kube-api-access-9fbpk\") pod \"node-resolver-vd2z9\" (UID: \"f86889d0-703b-43e8-b66e-5fe7a3632535\") " pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.548787 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.548657 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq97d\" (UniqueName: \"kubernetes.io/projected/a417814d-d92e-4dd2-92a6-8d311ee9542a-kube-api-access-sq97d\") pod \"multus-dxr8r\" (UID: \"a417814d-d92e-4dd2-92a6-8d311ee9542a\") " pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.550115 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.550076 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6vlj\" (UniqueName: \"kubernetes.io/projected/95748c1a-496b-46c0-9d7f-eac96cafda55-kube-api-access-r6vlj\") pod \"node-ca-dm9tm\" (UID: \"95748c1a-496b-46c0-9d7f-eac96cafda55\") " pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.554655 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.554607 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfm2x\" (UniqueName: \"kubernetes.io/projected/1a719967-78cc-4376-9ecb-b49d3f01c66b-kube-api-access-dfm2x\") pod \"aws-ebs-csi-driver-node-dbbfl\" (UID: \"1a719967-78cc-4376-9ecb-b49d3f01c66b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.554761 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.554683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbqr\" (UniqueName: \"kubernetes.io/projected/25cd6f50-f464-49ae-a833-6eafeb473291-kube-api-access-kjbqr\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:16.641039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.640948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-slash\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.640991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641045 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641059 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-slash\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-run\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-kubelet-config\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-ovn\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-run\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-env-overrides\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-kubernetes\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641237 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-kubelet-config\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-run-netns\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641263 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-ovn\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641287 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-kubernetes\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-lib-modules\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-run-netns\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-kubelet\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.641357 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovnkube-script-lib\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhrc\" (UniqueName: \"kubernetes.io/projected/342dd22f-6aa0-442e-b0f6-291a497a49ae-kube-api-access-ghhrc\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:16.641409 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:30:17.141391741 +0000 UTC m=+3.075030116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-host\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-lib-modules\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovnkube-config\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysconfig\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641518 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-systemd\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641543 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-node-log\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8adeed6a-2187-4327-a504-413c342e1ea6-agent-certs\") pod \"konnectivity-agent-9qdx6\" (UID: \"8adeed6a-2187-4327-a504-413c342e1ea6\") " pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-systemd\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.641817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-var-lib-kubelet\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-tuned\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8thm\" (UniqueName: \"kubernetes.io/projected/37763de9-2cdc-4747-97ab-97c4e02e0dd3-kube-api-access-l8thm\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-kubelet\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-etc-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641722 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-cni-netd\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-iptables-alerter-script\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641793 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-env-overrides\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37763de9-2cdc-4747-97ab-97c4e02e0dd3-tmp\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8adeed6a-2187-4327-a504-413c342e1ea6-konnectivity-ca\") pod \"konnectivity-agent-9qdx6\" (UID: \"8adeed6a-2187-4327-a504-413c342e1ea6\") " pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-host-slash\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-log-socket\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-sys\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-systemd-units\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-cni-bin\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.642729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovnkube-config\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.641991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovn-node-metrics-cert\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn2kt\" (UniqueName: \"kubernetes.io/projected/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-kube-api-access-wn2kt\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysctl-conf\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642045 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-host\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-modprobe-d\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-var-lib-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642127 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-systemd-units\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysctl-d\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642158 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-modprobe-d\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-dbus\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642212 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-cni-bin\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-var-lib-kubelet\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysconfig\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642254 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysctl-d\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642271 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovnkube-script-lib\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642278 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-run-systemd\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.643434 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-var-lib-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-host-slash\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642357 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-systemd\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642383 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-log-socket\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642417 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-node-log\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-sysctl-conf\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642482 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/37763de9-2cdc-4747-97ab-97c4e02e0dd3-sys\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642486 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-cni-netd\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-etc-openvswitch\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642589 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-dbus\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642733 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8adeed6a-2187-4327-a504-413c342e1ea6-konnectivity-ca\") pod \"konnectivity-agent-9qdx6\" (UID: \"8adeed6a-2187-4327-a504-413c342e1ea6\") " pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.642749 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342dd22f-6aa0-442e-b0f6-291a497a49ae-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.644162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.643014 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-iptables-alerter-script\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.644780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.644748 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37763de9-2cdc-4747-97ab-97c4e02e0dd3-tmp\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.645120 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.645075 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/342dd22f-6aa0-442e-b0f6-291a497a49ae-ovn-node-metrics-cert\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.646237 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.646200 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/37763de9-2cdc-4747-97ab-97c4e02e0dd3-etc-tuned\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.648461 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.648437 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8adeed6a-2187-4327-a504-413c342e1ea6-agent-certs\") pod \"konnectivity-agent-9qdx6\" (UID: \"8adeed6a-2187-4327-a504-413c342e1ea6\") " pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.659226 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.659195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhrc\" (UniqueName: \"kubernetes.io/projected/342dd22f-6aa0-442e-b0f6-291a497a49ae-kube-api-access-ghhrc\") pod \"ovnkube-node-mcnjr\" (UID: \"342dd22f-6aa0-442e-b0f6-291a497a49ae\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.660167 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.660141 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8thm\" (UniqueName: \"kubernetes.io/projected/37763de9-2cdc-4747-97ab-97c4e02e0dd3-kube-api-access-l8thm\") pod \"tuned-8kbkt\" (UID: \"37763de9-2cdc-4747-97ab-97c4e02e0dd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.660303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.660278 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn2kt\" (UniqueName: \"kubernetes.io/projected/75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79-kube-api-access-wn2kt\") pod \"iptables-alerter-jcmsn\" (UID: \"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79\") " pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.712804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.712775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vd2z9" Jul 21 18:30:16.721602 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.721577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dxr8r" Jul 21 18:30:16.734298 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.734277 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dm9tm" Jul 21 18:30:16.740037 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.740016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" Jul 21 18:30:16.748886 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.748863 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fps6j" Jul 21 18:30:16.756726 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.756698 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:16.763582 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.763545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:16.773288 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.773260 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jcmsn" Jul 21 18:30:16.779150 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.779130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" Jul 21 18:30:16.782902 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:16.782877 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 18:30:17.045155 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.045115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:17.045359 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.045260 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:17.045359 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.045324 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:18.045303199 +0000 UTC m=+3.978941577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:17.145463 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.145435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:17.145463 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.145469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:17.145659 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.145574 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:17.145659 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.145590 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:17.145659 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.145619 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:17.145659 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.145631 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:17.145659 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.145639 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:30:18.145621163 +0000 UTC m=+4.079259541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:17.145833 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:17.145666 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:18.145655505 +0000 UTC m=+4.079293882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:17.485061 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.485032 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 18:25:16 +0000 UTC" deadline="2028-01-06 18:37:16.390513933 +0000 UTC" Jul 21 18:30:17.485061 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.485061 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12816h6m58.905456078s" Jul 21 18:30:17.496291 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.496260 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda417814d_d92e_4dd2_92a6_8d311ee9542a.slice/crio-9f49224368e09e7ffc2a85efda748415f2b5ad11c15fa3e284c2f64f68c62e1b WatchSource:0}: Error finding container 9f49224368e09e7ffc2a85efda748415f2b5ad11c15fa3e284c2f64f68c62e1b: Status 404 returned error can't find the container with id 9f49224368e09e7ffc2a85efda748415f2b5ad11c15fa3e284c2f64f68c62e1b Jul 21 18:30:17.496705 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.496606 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a719967_78cc_4376_9ecb_b49d3f01c66b.slice/crio-0bd3a0497bb8c25d8819b66b84f2376cef689292cd1104fa0a4f84e3c541c108 WatchSource:0}: Error finding container 0bd3a0497bb8c25d8819b66b84f2376cef689292cd1104fa0a4f84e3c541c108: Status 404 returned error can't find the container with id 0bd3a0497bb8c25d8819b66b84f2376cef689292cd1104fa0a4f84e3c541c108 Jul 21 18:30:17.498397 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.498239 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b18d4d_7ac4_4f5f_8e3e_f2a8d4ec3b79.slice/crio-5fd3ccc32607f289a3317ed83b86c5aefb2886a557dc321876594ee265618a8e WatchSource:0}: Error finding container 5fd3ccc32607f289a3317ed83b86c5aefb2886a557dc321876594ee265618a8e: Status 404 returned error can't find the container with id 5fd3ccc32607f289a3317ed83b86c5aefb2886a557dc321876594ee265618a8e Jul 21 18:30:17.499704 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.499669 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf86889d0_703b_43e8_b66e_5fe7a3632535.slice/crio-8708ee614e496d72fdfc668773319e8545a4f0889b5ab00b5d1d3b7688398420 WatchSource:0}: Error finding container 8708ee614e496d72fdfc668773319e8545a4f0889b5ab00b5d1d3b7688398420: Status 404 returned error can't find the container with id 8708ee614e496d72fdfc668773319e8545a4f0889b5ab00b5d1d3b7688398420 Jul 21 18:30:17.525485 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.525454 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adeed6a_2187_4327_a504_413c342e1ea6.slice/crio-65ea7ffc95fcb4471985af185287c95932c78d57634d2601c7da20abcd3d368b WatchSource:0}: Error finding container 65ea7ffc95fcb4471985af185287c95932c78d57634d2601c7da20abcd3d368b: Status 404 returned error can't find the container with id 65ea7ffc95fcb4471985af185287c95932c78d57634d2601c7da20abcd3d368b Jul 21 18:30:17.526395 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.526135 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b6f525_5045_42af_bba6_e33a7ab072b1.slice/crio-6f27716207b6d123f4141dd9e52d6e9ee08c85a997895c9938bf5b26b3def808 WatchSource:0}: Error finding container 6f27716207b6d123f4141dd9e52d6e9ee08c85a997895c9938bf5b26b3def808: Status 404 returned error can't find the container with id 6f27716207b6d123f4141dd9e52d6e9ee08c85a997895c9938bf5b26b3def808 Jul 21 18:30:17.527289 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.527268 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37763de9_2cdc_4747_97ab_97c4e02e0dd3.slice/crio-6a2c9efb889d3a53f37b6ede9627a02608a783fe6a0792728d4d97d24f1aef31 WatchSource:0}: Error finding container 6a2c9efb889d3a53f37b6ede9627a02608a783fe6a0792728d4d97d24f1aef31: Status 404 returned error can't find the container with id 6a2c9efb889d3a53f37b6ede9627a02608a783fe6a0792728d4d97d24f1aef31 Jul 21 18:30:17.528869 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:17.528751 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95748c1a_496b_46c0_9d7f_eac96cafda55.slice/crio-4b781531a8c24d49047bef834ed6876f31e5916e845fd076d3f6d0ca8fed2983 WatchSource:0}: Error finding container 4b781531a8c24d49047bef834ed6876f31e5916e845fd076d3f6d0ca8fed2983: Status 404 returned error can't find the container with id 4b781531a8c24d49047bef834ed6876f31e5916e845fd076d3f6d0ca8fed2983 Jul 21 18:30:17.564796 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.564763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jcmsn" event={"ID":"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79","Type":"ContainerStarted","Data":"5fd3ccc32607f289a3317ed83b86c5aefb2886a557dc321876594ee265618a8e"} Jul 21 18:30:17.568277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.568247 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxr8r" event={"ID":"a417814d-d92e-4dd2-92a6-8d311ee9542a","Type":"ContainerStarted","Data":"9f49224368e09e7ffc2a85efda748415f2b5ad11c15fa3e284c2f64f68c62e1b"} Jul 21 18:30:17.569850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.569816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"b5dc94207379f4dd0a6a847c8f27deb123da1fd5c1d210975debcb3fb3bb7d2c"} Jul 21 18:30:17.570854 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.570824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dm9tm" event={"ID":"95748c1a-496b-46c0-9d7f-eac96cafda55","Type":"ContainerStarted","Data":"4b781531a8c24d49047bef834ed6876f31e5916e845fd076d3f6d0ca8fed2983"} Jul 21 18:30:17.571808 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.571790 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerStarted","Data":"6f27716207b6d123f4141dd9e52d6e9ee08c85a997895c9938bf5b26b3def808"} Jul 21 18:30:17.572760 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.572743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9qdx6" event={"ID":"8adeed6a-2187-4327-a504-413c342e1ea6","Type":"ContainerStarted","Data":"65ea7ffc95fcb4471985af185287c95932c78d57634d2601c7da20abcd3d368b"} Jul 21 18:30:17.576125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.576102 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" event={"ID":"1a719967-78cc-4376-9ecb-b49d3f01c66b","Type":"ContainerStarted","Data":"0bd3a0497bb8c25d8819b66b84f2376cef689292cd1104fa0a4f84e3c541c108"} Jul 21 18:30:17.579009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.578988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" event={"ID":"37763de9-2cdc-4747-97ab-97c4e02e0dd3","Type":"ContainerStarted","Data":"6a2c9efb889d3a53f37b6ede9627a02608a783fe6a0792728d4d97d24f1aef31"} Jul 21 18:30:17.580955 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:17.580935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vd2z9" event={"ID":"f86889d0-703b-43e8-b66e-5fe7a3632535","Type":"ContainerStarted","Data":"8708ee614e496d72fdfc668773319e8545a4f0889b5ab00b5d1d3b7688398420"} Jul 21 18:30:18.052750 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.052496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:18.052942 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.052708 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:18.052942 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.052827 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:20.052806605 +0000 UTC m=+5.986444978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:18.153846 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.153808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:18.154024 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.153872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:18.154153 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.154132 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:18.154239 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.154159 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:18.154239 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.154173 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:18.154239 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.154231 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:20.154211617 +0000 UTC m=+6.087850010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:18.154693 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.154615 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:18.154693 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.154670 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:30:20.154655113 +0000 UTC m=+6.088293489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:18.486169 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.486033 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 18:25:16 +0000 UTC" deadline="2028-01-13 12:32:51.434418037 +0000 UTC" Jul 21 18:30:18.486169 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.486107 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12978h2m32.948315856s" Jul 21 18:30:18.553710 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.553215 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:18.553710 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.553340 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:18.554059 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.554029 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:18.554200 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.554164 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:18.554259 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.554236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:18.554582 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:18.554312 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:18.602668 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.602630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" event={"ID":"f4f721e547e13bf17c3613886dc1af5b","Type":"ContainerStarted","Data":"0296316cfdd47207e441658c542ed9b61e99e03042c8b8501d500bad0dc5c474"} Jul 21 18:30:18.610753 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.610713 2565 generic.go:356] "Generic (PLEG): container finished" podID="b34d0b12dcb6af4c4556337d9f29d266" containerID="5f3238ba1a0ec0773a36153054f3a35a28e07748f1b0446f4f551ad8b140bc17" exitCode=0 Jul 21 18:30:18.610925 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.610763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" event={"ID":"b34d0b12dcb6af4c4556337d9f29d266","Type":"ContainerDied","Data":"5f3238ba1a0ec0773a36153054f3a35a28e07748f1b0446f4f551ad8b140bc17"} Jul 21 18:30:18.619446 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:18.619390 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-12.ec2.internal" podStartSLOduration=3.619370525 podStartE2EDuration="3.619370525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:18.619143638 +0000 UTC m=+4.552782033" watchObservedRunningTime="2026-07-21 18:30:18.619370525 +0000 UTC m=+4.553008921" Jul 21 18:30:19.626211 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:19.626056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" event={"ID":"b34d0b12dcb6af4c4556337d9f29d266","Type":"ContainerStarted","Data":"b237abc6a89e99dbafab18842af2ec4845aeb412d6c6c0a7e6958d2d9f3491a3"} Jul 21 18:30:19.655979 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:19.655361 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-12.ec2.internal" podStartSLOduration=4.655326585 podStartE2EDuration="4.655326585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:19.654451748 +0000 UTC m=+5.588090144" watchObservedRunningTime="2026-07-21 18:30:19.655326585 +0000 UTC m=+5.588964981" Jul 21 18:30:20.070068 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:20.070026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:20.070318 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.070233 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:20.070318 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.070300 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:24.07028052 +0000 UTC m=+10.003918892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:20.171223 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:20.171183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:20.171413 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:20.171251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:20.171477 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.171421 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:20.171531 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.171484 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:30:24.171466793 +0000 UTC m=+10.105105166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:20.171905 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.171886 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:20.172002 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.171916 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:20.172002 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.171929 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:20.172002 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.171972 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:24.171958521 +0000 UTC m=+10.105596898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:20.553240 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:20.553210 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:20.553421 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.553355 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:20.554033 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:20.553742 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:20.554033 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.553839 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:20.554033 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:20.553892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:20.554033 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:20.553962 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:22.551935 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:22.551904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:22.552331 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:22.552027 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:22.552331 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:22.552103 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:22.552331 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:22.552186 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:22.552331 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:22.551904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:22.552331 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:22.552274 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:24.102906 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:24.102866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:24.103321 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.103029 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:24.103321 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.103100 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:32.103069935 +0000 UTC m=+18.036708307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:24.203885 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:24.203845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:24.204050 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:24.203903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:24.204050 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.204042 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:24.204203 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.204129 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:30:32.20410585 +0000 UTC m=+18.137744241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:24.204625 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.204600 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:24.204625 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.204623 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:24.204791 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.204636 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:24.204791 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.204711 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:32.204696737 +0000 UTC m=+18.138335115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:24.563039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:24.561466 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:24.563039 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.561637 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:24.563039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:24.562174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:24.563039 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.562337 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:24.563039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:24.562737 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:24.563039 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:24.562866 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:26.552319 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:26.551797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:26.552319 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:26.551986 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:26.552319 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:26.552150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:26.552319 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:26.552212 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:26.553118 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:26.552862 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:26.553118 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:26.552933 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:28.552566 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:28.552528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:28.552566 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:28.552561 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:28.553113 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:28.552662 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:28.553113 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:28.553016 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:28.553236 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:28.553155 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:28.553290 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:28.553237 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:30.551870 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:30.551829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:30.552367 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:30.551836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:30.552367 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:30.551958 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:30.552367 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:30.552008 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:30.552367 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:30.551829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:30.552367 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:30.552163 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:32.165501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:32.165412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:32.165905 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.165607 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:32.165905 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.165685 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:48.16566405 +0000 UTC m=+34.099302429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:32.266197 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:32.266139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:32.266207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.266323 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.266322 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.266344 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.266358 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.266398 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:30:48.266383883 +0000 UTC m=+34.200022255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:32.266431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.266415 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:48.266408849 +0000 UTC m=+34.200047222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:32.552604 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:32.552570 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:32.552789 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:32.552576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:32.552789 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.552708 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:32.552789 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:32.552761 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:32.552945 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.552832 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:32.552945 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:32.552895 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:34.552717 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:34.552678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:34.553109 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:34.552774 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:34.553109 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:34.552799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:34.553109 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:34.552817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:34.553109 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:34.552918 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:34.553109 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:34.553005 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:36.552690 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:36.552650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:36.552690 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:36.552681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:36.553289 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:36.552650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:36.553289 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:36.552799 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:36.553289 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:36.552882 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:36.553289 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:36.552892 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:37.671928 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.671622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672274 2565 generic.go:356] "Generic (PLEG): container finished" podID="342dd22f-6aa0-442e-b0f6-291a497a49ae" containerID="c1bdee164d2cfad7fa6f2518f02bbf931bc9d83ee78ea54f1e30af681a429c62" exitCode=1 Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"3fc3e7f36b9bc74891f872dd2bcf188ff0123f61a9db7216f18b70d1165ba0e8"} Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672441 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"c138bdbe30c0e7ca5c01e3ba26072d4dbe66f0807a25438154fc826acb2664b3"} Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672476 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"fc9a3d22404bbda36ac0cb9714f796048db8987059a73a864cc63bd4431cfb28"} Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"53e6aad8534ecdd20383ba9f46d0a4d1596426dbd04b81f4e78c26f6fce1c7d0"} Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerDied","Data":"c1bdee164d2cfad7fa6f2518f02bbf931bc9d83ee78ea54f1e30af681a429c62"} Jul 21 18:30:37.672681 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.672581 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"a5cfbfb2d0aff03dd1a41e5d6727c8bd0e78f18754ee4dcb0e36868ddcff6aa7"} Jul 21 18:30:37.673760 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.673730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dm9tm" event={"ID":"95748c1a-496b-46c0-9d7f-eac96cafda55","Type":"ContainerStarted","Data":"986f52bdda0c4e5cca51d10f5afd42853f091163b7d523382cb0ad242c599f74"} Jul 21 18:30:37.675220 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.675199 2565 generic.go:356] "Generic (PLEG): container finished" podID="63b6f525-5045-42af-bba6-e33a7ab072b1" containerID="ddd4e666a6e55b1efdce24fa470bbe3961a0d4da3d7a3f37fa5c5414b1477a92" exitCode=0 Jul 21 18:30:37.675312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.675277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerDied","Data":"ddd4e666a6e55b1efdce24fa470bbe3961a0d4da3d7a3f37fa5c5414b1477a92"} Jul 21 18:30:37.676694 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.676673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9qdx6" event={"ID":"8adeed6a-2187-4327-a504-413c342e1ea6","Type":"ContainerStarted","Data":"b9259271fe3dc3feff80dd2c5a3ccf8cce67aadfea69cd5ae4c51f902f10d56a"} Jul 21 18:30:37.678303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.678281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" event={"ID":"1a719967-78cc-4376-9ecb-b49d3f01c66b","Type":"ContainerStarted","Data":"54bffd464190d7a9ffe04874e03e724cf93e7ffcc35e775fa276a7313ae9435a"} Jul 21 18:30:37.679648 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.679628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" event={"ID":"37763de9-2cdc-4747-97ab-97c4e02e0dd3","Type":"ContainerStarted","Data":"01a23c3d1037e642233a50cd0efff011226bda61d7e57b11e45aebaafffbf701"} Jul 21 18:30:37.680964 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.680945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vd2z9" event={"ID":"f86889d0-703b-43e8-b66e-5fe7a3632535","Type":"ContainerStarted","Data":"72c3ae398aed37924fcf2103246d0e2b26e3a7c5e330f009442aa1dd44d51022"} Jul 21 18:30:37.682313 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.682295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dxr8r" event={"ID":"a417814d-d92e-4dd2-92a6-8d311ee9542a","Type":"ContainerStarted","Data":"c4d263ae5155dccf7990faa2db44e5e3a091293d75088f4ba9798ad73e173da4"} Jul 21 18:30:37.691919 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.691881 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dm9tm" podStartSLOduration=4.653480637 podStartE2EDuration="23.691869058s" totalImagesPullingTime="19.038388421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:37.691393081 +0000 UTC m=+23.625031475" watchObservedRunningTime="2026-07-21 18:30:37.691869058 +0000 UTC m=+23.625507451" Jul 21 18:30:37.709558 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.709483 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9qdx6" podStartSLOduration=9.353434092 podStartE2EDuration="23.709463853s" totalImagesPullingTime="14.356029761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:37.705778472 +0000 UTC m=+23.639416865" watchObservedRunningTime="2026-07-21 18:30:37.709463853 +0000 UTC m=+23.643102248" Jul 21 18:30:37.724587 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.724527 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8kbkt" podStartSLOduration=3.663283501 podStartE2EDuration="22.724506823s" totalImagesPullingTime="19.061223322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:37.723735403 +0000 UTC m=+23.657373797" watchObservedRunningTime="2026-07-21 18:30:37.724506823 +0000 UTC m=+23.658145220" Jul 21 18:30:37.740538 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.740492 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vd2z9" podStartSLOduration=4.796805835 podStartE2EDuration="23.740478186s" totalImagesPullingTime="18.943672351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:37.740129289 +0000 UTC m=+23.673767685" watchObservedRunningTime="2026-07-21 18:30:37.740478186 +0000 UTC m=+23.674116579" Jul 21 18:30:37.802531 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:37.802478 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dxr8r" podStartSLOduration=4.711424605 podStartE2EDuration="23.802456694s" totalImagesPullingTime="19.091032089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:37.769326903 +0000 UTC m=+23.702965296" watchObservedRunningTime="2026-07-21 18:30:37.802456694 +0000 UTC m=+23.736095089" Jul 21 18:30:38.230002 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.229979 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 18:30:38.485624 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.485470 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T18:30:38.229998554Z","UUID":"6a7e01a9-cd33-4489-8b84-1130b4bd0cbc","Handler":null,"Name":"","Endpoint":""} Jul 21 18:30:38.486961 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.486945 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 18:30:38.487068 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.486976 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 18:30:38.552242 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.552208 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:38.552471 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.552208 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:38.552471 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:38.552351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:38.552471 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.552208 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:38.552471 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:38.552441 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:38.552660 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:38.552493 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:38.685890 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.685822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jcmsn" event={"ID":"75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79","Type":"ContainerStarted","Data":"08926e50ca33981a62303493e398e6c2e8dbfe79942c17b1b76206704585e12d"} Jul 21 18:30:38.687833 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.687766 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" event={"ID":"1a719967-78cc-4376-9ecb-b49d3f01c66b","Type":"ContainerStarted","Data":"83c628b7188a6310c2247c0089f480a04bc85761488009ff561f7938bc28c717"} Jul 21 18:30:38.699929 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:38.699888 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jcmsn" podStartSLOduration=4.768895635 podStartE2EDuration="23.699870322s" totalImagesPullingTime="18.930974687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:38.699265198 +0000 UTC m=+24.632903592" watchObservedRunningTime="2026-07-21 18:30:38.699870322 +0000 UTC m=+24.633508719" Jul 21 18:30:39.693016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:39.692928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" event={"ID":"1a719967-78cc-4376-9ecb-b49d3f01c66b","Type":"ContainerStarted","Data":"4b8b6171b30e8143647ea5f5fdcb0bfc98e5dca11e565d5fab0bdda606f962c1"} Jul 21 18:30:39.696714 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:39.696691 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:30:39.697131 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:39.697108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"16a8b949e79dc4839ba7409f36363f2683be58b442f9563d435c0ff4bc6c6a02"} Jul 21 18:30:39.710714 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:39.710663 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dbbfl" podStartSLOduration=4.422652073 podStartE2EDuration="25.710647323s" totalImagesPullingTime="21.28799525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:39.710422259 +0000 UTC m=+25.644060666" watchObservedRunningTime="2026-07-21 18:30:39.710647323 +0000 UTC m=+25.644285716" Jul 21 18:30:40.552537 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:40.552294 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:40.552692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:40.552294 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:40.552692 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:40.552647 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:40.552692 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:40.552684 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:40.552830 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:40.552301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:40.552830 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:40.552752 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:40.688108 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:40.688057 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:40.688728 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:40.688704 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:41.626862 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:41.626825 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:41.627660 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:41.627523 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9qdx6" Jul 21 18:30:42.552428 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:42.552405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:42.552428 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:42.552417 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:42.552603 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:42.552584 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:42.552766 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:42.552738 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:42.552824 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:42.552778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:42.552924 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:42.552904 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:42.708148 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:42.708125 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:30:42.708893 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:42.708550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"9f33c4ffea074ee683dc279d4d4618b9a001fdc73c2cf07917269e4ee55dfd87"} Jul 21 18:30:42.709051 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:42.709035 2565 scope.go:117] "RemoveContainer" containerID="c1bdee164d2cfad7fa6f2518f02bbf931bc9d83ee78ea54f1e30af681a429c62" Jul 21 18:30:43.714183 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.713974 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:30:43.714576 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.714490 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" event={"ID":"342dd22f-6aa0-442e-b0f6-291a497a49ae","Type":"ContainerStarted","Data":"b61ace29d16b35b08f661b1b66b7f72a497363c5dee971b7baab5a7bb68057ef"} Jul 21 18:30:43.714710 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.714693 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:43.714872 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.714847 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:43.714976 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.714910 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:43.717073 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.717040 2565 generic.go:356] "Generic (PLEG): container finished" podID="63b6f525-5045-42af-bba6-e33a7ab072b1" containerID="93405f99a2b0a3244e3f331796f5a875f9311cb566d54fc9cf7f8e63eb8bf75b" exitCode=0 Jul 21 18:30:43.717186 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.717071 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerDied","Data":"93405f99a2b0a3244e3f331796f5a875f9311cb566d54fc9cf7f8e63eb8bf75b"} Jul 21 18:30:43.732200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.732139 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:43.732343 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.732254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:30:43.746843 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:43.746801 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" podStartSLOduration=10.623216514 podStartE2EDuration="29.746786124s" totalImagesPullingTime="19.12356961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:30:43.74555611 +0000 UTC m=+29.679194504" watchObservedRunningTime="2026-07-21 18:30:43.746786124 +0000 UTC m=+29.680424518" Jul 21 18:30:44.552878 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.552845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:44.553078 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.552938 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:44.553078 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:44.552963 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:44.553078 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:44.553064 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:44.553269 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.553132 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:44.553269 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:44.553250 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:44.971518 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.971436 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6d7dw"] Jul 21 18:30:44.971924 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.971545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:44.971924 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:44.971634 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:44.973743 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.973711 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zfx75"] Jul 21 18:30:44.973872 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.973823 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:44.973930 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:44.973912 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:44.979446 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.979406 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2656j"] Jul 21 18:30:44.979594 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:44.979532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:44.979635 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:44.979620 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:45.724100 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:45.724048 2565 generic.go:356] "Generic (PLEG): container finished" podID="63b6f525-5045-42af-bba6-e33a7ab072b1" containerID="b0c7b0c338d23ee105f97b90953c82f3ce4c0c594aa75f99559fe6b79adf3ce7" exitCode=0 Jul 21 18:30:45.724249 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:45.724139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerDied","Data":"b0c7b0c338d23ee105f97b90953c82f3ce4c0c594aa75f99559fe6b79adf3ce7"} Jul 21 18:30:46.552937 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:46.552709 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:46.553322 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:46.552727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:46.553322 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:46.552971 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:46.553322 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:46.552727 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:46.553322 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:46.553040 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:46.553322 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:46.553151 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:48.180762 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.180724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:48.181237 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.180850 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:48.181237 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.180904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs podName:25cd6f50-f464-49ae-a833-6eafeb473291 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:20.180889601 +0000 UTC m=+66.114527973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs") pod "network-metrics-daemon-zfx75" (UID: "25cd6f50-f464-49ae-a833-6eafeb473291") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 18:30:48.281180 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.281152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:48.281275 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.281196 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:48.281324 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.281313 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:48.281368 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.281347 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 18:30:48.281415 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.281392 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 18:30:48.281452 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.281422 2565 projected.go:196] Error preparing data for projected volume kube-api-access-pnsm9 for pod openshift-network-diagnostics/network-check-target-2656j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:48.281452 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.281366 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret podName:781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad nodeName:}" failed. No retries permitted until 2026-07-21 18:31:20.281353116 +0000 UTC m=+66.214991489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret") pod "global-pull-secret-syncer-6d7dw" (UID: "781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad") : object "kube-system"/"original-pull-secret" not registered Jul 21 18:30:48.281527 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.281477 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9 podName:acf3797e-b0ff-4e5a-b0f8-eca8ba970770 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:20.2814613 +0000 UTC m=+66.215099690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pnsm9" (UniqueName: "kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9") pod "network-check-target-2656j" (UID: "acf3797e-b0ff-4e5a-b0f8-eca8ba970770") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 18:30:48.552218 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.552183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:48.552218 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.552209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:48.552418 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.552186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:48.552418 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.552330 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zfx75" podUID="25cd6f50-f464-49ae-a833-6eafeb473291" Jul 21 18:30:48.552418 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.552361 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6d7dw" podUID="781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad" Jul 21 18:30:48.552418 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:48.552409 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2656j" podUID="acf3797e-b0ff-4e5a-b0f8-eca8ba970770" Jul 21 18:30:48.732156 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.732118 2565 generic.go:356] "Generic (PLEG): container finished" podID="63b6f525-5045-42af-bba6-e33a7ab072b1" containerID="703f09524fc3e7464033045c508b65d487844109c1e8841ddcb5a91d20d3faa3" exitCode=0 Jul 21 18:30:48.732300 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:48.732164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerDied","Data":"703f09524fc3e7464033045c508b65d487844109c1e8841ddcb5a91d20d3faa3"} Jul 21 18:30:49.409359 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.409331 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-12.ec2.internal" event="NodeReady" Jul 21 18:30:49.409962 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.409484 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 18:30:49.469699 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.469613 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b6775fc7-h8brm"] Jul 21 18:30:49.473508 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.473474 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.474019 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.473945 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4"] Jul 21 18:30:49.477032 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.477008 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.477619 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.477595 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 18:30:49.492127 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.491304 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xl85l"] Jul 21 18:30:49.494568 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.494543 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67c9769c8d-svp7r"] Jul 21 18:30:49.494706 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.494671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.497860 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.497840 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp"] Jul 21 18:30:49.497998 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.497981 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.498534 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.498513 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 18:30:49.501386 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.501366 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8lj5b\"" Jul 21 18:30:49.501677 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.501656 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4"] Jul 21 18:30:49.501804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.501788 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 18:30:49.501863 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.501819 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.502020 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.502005 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 18:30:49.502075 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.502034 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" Jul 21 18:30:49.502312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.502296 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.502659 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.502522 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kjmkt\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.502843 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.503579 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.503729 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.503834 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.503996 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504005 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504039 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n5cs6\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504132 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504231 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504262 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 21 18:30:49.504378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504270 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f2hht\"" Jul 21 18:30:49.504893 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504452 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 21 18:30:49.504893 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.504560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 21 18:30:49.506537 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.506520 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz"] Jul 21 18:30:49.506645 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.506626 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.508979 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.508961 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk"] Jul 21 18:30:49.509121 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.509081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.512504 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.512486 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hgfk5"] Jul 21 18:30:49.512609 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.512593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:49.515268 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.515250 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.515695 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.515673 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4"] Jul 21 18:30:49.515809 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.515772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.522687 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.522656 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 21 18:30:49.525209 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.525187 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xl85l"] Jul 21 18:30:49.537539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537375 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.537539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 18:30:49.537539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537422 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 18:30:49.537539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537438 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.537539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537469 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.537864 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537706 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.537919 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537873 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 18:30:49.537919 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.537875 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.538276 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538136 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 21 18:30:49.538276 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538213 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zjkgp\"" Jul 21 18:30:49.538276 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538231 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.538463 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538408 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 21 18:30:49.538463 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538458 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 21 18:30:49.538551 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538535 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.538604 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538579 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.538669 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538651 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hk5r5\"" Jul 21 18:30:49.538792 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538675 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.538876 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538859 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7nm8g\"" Jul 21 18:30:49.538930 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538912 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.538986 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538862 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-j6pc6\"" Jul 21 18:30:49.539032 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.538868 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lghvf\"" Jul 21 18:30:49.539772 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.539754 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 21 18:30:49.550518 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.550455 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b6775fc7-h8brm"] Jul 21 18:30:49.551115 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.550829 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67c9769c8d-svp7r"] Jul 21 18:30:49.552193 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.552172 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 21 18:30:49.557536 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.557437 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9hkz5"] Jul 21 18:30:49.580422 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.580394 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n54cs"] Jul 21 18:30:49.580927 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.580907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.584996 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.584778 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwq42\"" Jul 21 18:30:49.584996 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.584793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 18:30:49.585292 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.585273 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 18:30:49.589552 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtccx\" (UniqueName: \"kubernetes.io/projected/92b73819-48f9-42a1-817a-813c899b1853-kube-api-access-rtccx\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.589650 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-service-ca-bundle\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.589650 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkzp6\" (UniqueName: \"kubernetes.io/projected/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-kube-api-access-hkzp6\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.589650 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-trusted-ca\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.589650 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4247d7cb-61b6-44e1-afa6-57876b5e44a6-trusted-ca\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-tmp\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c110131-b834-4e7d-abb0-c044b1d1fa0f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7l7r\" (UniqueName: \"kubernetes.io/projected/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-kube-api-access-v7l7r\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/563dcd7d-5673-4890-b407-178d6f04ee11-ca-trust-extracted\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589819 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4527c326-62ce-4224-94e6-f4f8f85be296-config\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.589850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4527c326-62ce-4224-94e6-f4f8f85be296-serving-cert\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-image-registry-private-configuration\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-registry-certificates\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-bound-sa-token\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.589981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fds66\" (UniqueName: \"kubernetes.io/projected/2c110131-b834-4e7d-abb0-c044b1d1fa0f-kube-api-access-fds66\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5f2n\" (UniqueName: \"kubernetes.io/projected/4247d7cb-61b6-44e1-afa6-57876b5e44a6-kube-api-access-n5f2n\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590067 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g4r2\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-kube-api-access-9g4r2\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kn56\" (UniqueName: \"kubernetes.io/projected/e5b91385-4133-4ee3-a2f6-71fd7f6d4eed-kube-api-access-5kn56\") pod \"volume-data-source-validator-78cf4c6f6-lpzvp\" (UID: \"e5b91385-4133-4ee3-a2f6-71fd7f6d4eed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4247d7cb-61b6-44e1-afa6-57876b5e44a6-serving-cert\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.590230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c110131-b834-4e7d-abb0-c044b1d1fa0f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-snapshots\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-serving-cert\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhq7j\" (UniqueName: \"kubernetes.io/projected/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-kube-api-access-mhq7j\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-default-certificate\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6xjt\" (UniqueName: \"kubernetes.io/projected/4527c326-62ce-4224-94e6-f4f8f85be296-kube-api-access-f6xjt\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-stats-auth\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4247d7cb-61b6-44e1-afa6-57876b5e44a6-config\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.590839 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.590566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-installation-pull-secrets\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.597579 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.596249 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp"] Jul 21 18:30:49.597579 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.596360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.600477 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.599888 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.600477 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.600109 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.600477 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.600321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 18:30:49.600877 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.600756 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j4zws\"" Jul 21 18:30:49.612549 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.612518 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v729j"] Jul 21 18:30:49.613736 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.613717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" Jul 21 18:30:49.618234 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.618211 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zb5nf\"" Jul 21 18:30:49.618511 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.618493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 18:30:49.618581 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.618544 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 18:30:49.634719 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634687 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634729 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634761 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9hkz5"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hgfk5"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634804 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634832 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4"] Jul 21 18:30:49.634849 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634843 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:49.635157 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634856 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v729j"] Jul 21 18:30:49.635157 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.634873 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n54cs"] Jul 21 18:30:49.637838 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.637821 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 18:30:49.637928 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.637873 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 18:30:49.638508 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.638494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-njwcm\"" Jul 21 18:30:49.691184 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4527c326-62ce-4224-94e6-f4f8f85be296-serving-cert\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-image-registry-private-configuration\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv6sc\" (UniqueName: \"kubernetes.io/projected/418fa088-8dc7-49be-af50-5dae49b6dad6-kube-api-access-hv6sc\") pod \"network-check-source-7bc5b6bf85-6psgp\" (UID: \"418fa088-8dc7-49be-af50-5dae49b6dad6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-registry-certificates\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-bound-sa-token\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fds66\" (UniqueName: \"kubernetes.io/projected/2c110131-b834-4e7d-abb0-c044b1d1fa0f-kube-api-access-fds66\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.691355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.691693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5f2n\" (UniqueName: \"kubernetes.io/projected/4247d7cb-61b6-44e1-afa6-57876b5e44a6-kube-api-access-n5f2n\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.691693 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.691409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.691797 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.691384 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 18:30:49.691797 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.691765 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b6775fc7-h8brm: secret "image-registry-tls" not found Jul 21 18:30:49.691893 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.691857 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls podName:563dcd7d-5673-4890-b407-178d6f04ee11 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.191830155 +0000 UTC m=+36.125468716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls") pod "image-registry-77b6775fc7-h8brm" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11") : secret "image-registry-tls" not found Jul 21 18:30:49.692046 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g4r2\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-kube-api-access-9g4r2\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.692046 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692022 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-registry-certificates\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.692217 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kn56\" (UniqueName: \"kubernetes.io/projected/e5b91385-4133-4ee3-a2f6-71fd7f6d4eed-kube-api-access-5kn56\") pod \"volume-data-source-validator-78cf4c6f6-lpzvp\" (UID: \"e5b91385-4133-4ee3-a2f6-71fd7f6d4eed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" Jul 21 18:30:49.692217 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4247d7cb-61b6-44e1-afa6-57876b5e44a6-serving-cert\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.692333 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.692333 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c110131-b834-4e7d-abb0-c044b1d1fa0f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.692333 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2387f71e-ff4d-459c-a1f9-ca28a78e1800-cert\") pod \"ingress-canary-n54cs\" (UID: \"2387f71e-ff4d-459c-a1f9-ca28a78e1800\") " pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.692333 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692327 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgs4r\" (UniqueName: \"kubernetes.io/projected/2387f71e-ff4d-459c-a1f9-ca28a78e1800-kube-api-access-fgs4r\") pod \"ingress-canary-n54cs\" (UID: \"2387f71e-ff4d-459c-a1f9-ca28a78e1800\") " pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.692379 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-snapshots\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-serving-cert\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.692467 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.192448582 +0000 UTC m=+36.126086973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : secret "router-metrics-certs-default" not found Jul 21 18:30:49.692523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-tmp-dir\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.692549 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.192533295 +0000 UTC m=+36.126171674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : configmap references non-existent config key: service-ca.crt Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhq7j\" (UniqueName: \"kubernetes.io/projected/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-kube-api-access-mhq7j\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-default-certificate\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6xjt\" (UniqueName: \"kubernetes.io/projected/4527c326-62ce-4224-94e6-f4f8f85be296-kube-api-access-f6xjt\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-stats-auth\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4247d7cb-61b6-44e1-afa6-57876b5e44a6-config\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-installation-pull-secrets\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.692851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.692809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-config-volume\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.693305 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.693010 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-snapshots\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.693444 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.693423 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 18:30:49.693677 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.693588 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls podName:55118b09-cb92-4ba4-a0fd-3a1c350fe03a nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.193466161 +0000 UTC m=+36.127104533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4tskk" (UID: "55118b09-cb92-4ba4-a0fd-3a1c350fe03a") : secret "samples-operator-tls" not found Jul 21 18:30:49.694166 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694139 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.694260 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmf4\" (UniqueName: \"kubernetes.io/projected/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-kube-api-access-kzmf4\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.694260 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtccx\" (UniqueName: \"kubernetes.io/projected/92b73819-48f9-42a1-817a-813c899b1853-kube-api-access-rtccx\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.694360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694272 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-service-ca-bundle\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.694360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkzp6\" (UniqueName: \"kubernetes.io/projected/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-kube-api-access-hkzp6\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.694360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-trusted-ca\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.694360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4247d7cb-61b6-44e1-afa6-57876b5e44a6-trusted-ca\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694375 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4247d7cb-61b6-44e1-afa6-57876b5e44a6-config\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-tmp\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c110131-b834-4e7d-abb0-c044b1d1fa0f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7l7r\" (UniqueName: \"kubernetes.io/projected/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-kube-api-access-v7l7r\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/563dcd7d-5673-4890-b407-178d6f04ee11-ca-trust-extracted\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.694555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4527c326-62ce-4224-94e6-f4f8f85be296-config\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.694875 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.694851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-service-ca-bundle\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.695081 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.695057 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4527c326-62ce-4224-94e6-f4f8f85be296-config\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.695081 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.695149 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:49.695321 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.695194 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls podName:ecd290ce-81cb-4e9b-8f87-1adb3f55df0e nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.195180233 +0000 UTC m=+36.128818604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqsd4" (UID: "ecd290ce-81cb-4e9b-8f87-1adb3f55df0e") : secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:49.695392 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.695324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-tmp\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.695926 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.695900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c110131-b834-4e7d-abb0-c044b1d1fa0f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.696260 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-trusted-ca\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.696424 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/563dcd7d-5673-4890-b407-178d6f04ee11-ca-trust-extracted\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.696872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c110131-b834-4e7d-abb0-c044b1d1fa0f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.696891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-serving-cert\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.696990 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4247d7cb-61b6-44e1-afa6-57876b5e44a6-trusted-ca\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.697029 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4247d7cb-61b6-44e1-afa6-57876b5e44a6-serving-cert\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.697379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.697334 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-image-registry-private-configuration\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.698765 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.698738 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-installation-pull-secrets\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.698877 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.698812 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4527c326-62ce-4224-94e6-f4f8f85be296-serving-cert\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.698972 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.698947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-default-certificate\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.699147 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.699129 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-stats-auth\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.710439 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.710416 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-bound-sa-token\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.710942 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.710926 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g4r2\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-kube-api-access-9g4r2\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:49.718464 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.718428 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7l7r\" (UniqueName: \"kubernetes.io/projected/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-kube-api-access-v7l7r\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:49.720056 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.719997 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtccx\" (UniqueName: \"kubernetes.io/projected/92b73819-48f9-42a1-817a-813c899b1853-kube-api-access-rtccx\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:49.720581 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.720541 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhq7j\" (UniqueName: \"kubernetes.io/projected/c3180351-57cd-4a37-a9e8-f9c4b01dde1b-kube-api-access-mhq7j\") pod \"insights-operator-555d9d7885-xl85l\" (UID: \"c3180351-57cd-4a37-a9e8-f9c4b01dde1b\") " pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.721915 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.721891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6xjt\" (UniqueName: \"kubernetes.io/projected/4527c326-62ce-4224-94e6-f4f8f85be296-kube-api-access-f6xjt\") pod \"service-ca-operator-5bcbc94c78-6ttsz\" (UID: \"4527c326-62ce-4224-94e6-f4f8f85be296\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.723451 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.723427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kn56\" (UniqueName: \"kubernetes.io/projected/e5b91385-4133-4ee3-a2f6-71fd7f6d4eed-kube-api-access-5kn56\") pod \"volume-data-source-validator-78cf4c6f6-lpzvp\" (UID: \"e5b91385-4133-4ee3-a2f6-71fd7f6d4eed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" Jul 21 18:30:49.724024 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.723983 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fds66\" (UniqueName: \"kubernetes.io/projected/2c110131-b834-4e7d-abb0-c044b1d1fa0f-kube-api-access-fds66\") pod \"kube-storage-version-migrator-operator-7658d9b749-kxkj4\" (UID: \"2c110131-b834-4e7d-abb0-c044b1d1fa0f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.726304 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.726282 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkzp6\" (UniqueName: \"kubernetes.io/projected/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-kube-api-access-hkzp6\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:49.728232 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.728213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5f2n\" (UniqueName: \"kubernetes.io/projected/4247d7cb-61b6-44e1-afa6-57876b5e44a6-kube-api-access-n5f2n\") pod \"console-operator-565b7b569d-hgfk5\" (UID: \"4247d7cb-61b6-44e1-afa6-57876b5e44a6\") " pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.795517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.795294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2387f71e-ff4d-459c-a1f9-ca28a78e1800-cert\") pod \"ingress-canary-n54cs\" (UID: \"2387f71e-ff4d-459c-a1f9-ca28a78e1800\") " pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.795517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.795340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgs4r\" (UniqueName: \"kubernetes.io/projected/2387f71e-ff4d-459c-a1f9-ca28a78e1800-kube-api-access-fgs4r\") pod \"ingress-canary-n54cs\" (UID: \"2387f71e-ff4d-459c-a1f9-ca28a78e1800\") " pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.795517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.795385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-tmp-dir\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.795517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.795451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-config-volume\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.795517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.795477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmf4\" (UniqueName: \"kubernetes.io/projected/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-kube-api-access-kzmf4\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.796112 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.795901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f0ed91a-e26b-4baa-ac66-6024848db838-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:49.796112 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.796000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:49.796112 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.796037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv6sc\" (UniqueName: \"kubernetes.io/projected/418fa088-8dc7-49be-af50-5dae49b6dad6-kube-api-access-hv6sc\") pod \"network-check-source-7bc5b6bf85-6psgp\" (UID: \"418fa088-8dc7-49be-af50-5dae49b6dad6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" Jul 21 18:30:49.796813 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.796079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.796813 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.796407 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 18:30:49.796813 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.796461 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls podName:9742bb19-be0c-41fe-8ea6-e4af1161ba5c nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.29644456 +0000 UTC m=+36.230082945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls") pod "dns-default-9hkz5" (UID: "9742bb19-be0c-41fe-8ea6-e4af1161ba5c") : secret "dns-default-metrics-tls" not found Jul 21 18:30:49.800119 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.799717 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2387f71e-ff4d-459c-a1f9-ca28a78e1800-cert\") pod \"ingress-canary-n54cs\" (UID: \"2387f71e-ff4d-459c-a1f9-ca28a78e1800\") " pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.801694 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.800364 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-tmp-dir\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.801694 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.800792 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-config-volume\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.811813 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.811781 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xl85l" Jul 21 18:30:49.814862 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.814829 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgs4r\" (UniqueName: \"kubernetes.io/projected/2387f71e-ff4d-459c-a1f9-ca28a78e1800-kube-api-access-fgs4r\") pod \"ingress-canary-n54cs\" (UID: \"2387f71e-ff4d-459c-a1f9-ca28a78e1800\") " pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.816158 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.816133 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv6sc\" (UniqueName: \"kubernetes.io/projected/418fa088-8dc7-49be-af50-5dae49b6dad6-kube-api-access-hv6sc\") pod \"network-check-source-7bc5b6bf85-6psgp\" (UID: \"418fa088-8dc7-49be-af50-5dae49b6dad6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" Jul 21 18:30:49.816834 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.816817 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmf4\" (UniqueName: \"kubernetes.io/projected/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-kube-api-access-kzmf4\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:49.825383 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.825358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" Jul 21 18:30:49.832867 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.832849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" Jul 21 18:30:49.840892 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.840869 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" Jul 21 18:30:49.856426 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.856346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:30:49.898909 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.897459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f0ed91a-e26b-4baa-ac66-6024848db838-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:49.898909 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.897568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:49.898909 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.897860 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 18:30:49.898909 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:49.897924 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert podName:5f0ed91a-e26b-4baa-ac66-6024848db838 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:50.397905329 +0000 UTC m=+36.331543715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v729j" (UID: "5f0ed91a-e26b-4baa-ac66-6024848db838") : secret "networking-console-plugin-cert" not found Jul 21 18:30:49.898909 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.898840 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5f0ed91a-e26b-4baa-ac66-6024848db838-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:49.911924 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.911675 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n54cs" Jul 21 18:30:49.927767 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:49.927591 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" Jul 21 18:30:50.093517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.093269 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xl85l"] Jul 21 18:30:50.094984 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.094923 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp"] Jul 21 18:30:50.097384 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:50.097254 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3180351_57cd_4a37_a9e8_f9c4b01dde1b.slice/crio-14f5543ca6a18170e5750943c0575602626adae8ccbc8fc31345e1bc3e46b722 WatchSource:0}: Error finding container 14f5543ca6a18170e5750943c0575602626adae8ccbc8fc31345e1bc3e46b722: Status 404 returned error can't find the container with id 14f5543ca6a18170e5750943c0575602626adae8ccbc8fc31345e1bc3e46b722 Jul 21 18:30:50.099028 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:50.098990 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b91385_4133_4ee3_a2f6_71fd7f6d4eed.slice/crio-3289538c9d94ffb5a4e1be83c1bd99ffd9168833b4022b1e4d31372c32f87c30 WatchSource:0}: Error finding container 3289538c9d94ffb5a4e1be83c1bd99ffd9168833b4022b1e4d31372c32f87c30: Status 404 returned error can't find the container with id 3289538c9d94ffb5a4e1be83c1bd99ffd9168833b4022b1e4d31372c32f87c30 Jul 21 18:30:50.107216 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.107187 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4"] Jul 21 18:30:50.115980 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.114486 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz"] Jul 21 18:30:50.120887 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:50.120794 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4527c326_62ce_4224_94e6_f4f8f85be296.slice/crio-3286278f1d80f08127166e6a3db82d146bcbc46887ffd3c31469ff12a319656a WatchSource:0}: Error finding container 3286278f1d80f08127166e6a3db82d146bcbc46887ffd3c31469ff12a319656a: Status 404 returned error can't find the container with id 3286278f1d80f08127166e6a3db82d146bcbc46887ffd3c31469ff12a319656a Jul 21 18:30:50.125600 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.124957 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-hgfk5"] Jul 21 18:30:50.128803 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:50.128773 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4247d7cb_61b6_44e1_afa6_57876b5e44a6.slice/crio-cc593ae9ffe822e14b5cd8c4cd73bdc5c5c54a5fe1660cd787e9001d44da64f4 WatchSource:0}: Error finding container cc593ae9ffe822e14b5cd8c4cd73bdc5c5c54a5fe1660cd787e9001d44da64f4: Status 404 returned error can't find the container with id cc593ae9ffe822e14b5cd8c4cd73bdc5c5c54a5fe1660cd787e9001d44da64f4 Jul 21 18:30:50.184377 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:30:50.184028 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2387f71e_ff4d_459c_a1f9_ca28a78e1800.slice/crio-2bec25dede6a10e2618f12097a6a39738d0fe5e1b3fad7694bcdeafc7df05296 WatchSource:0}: Error finding container 2bec25dede6a10e2618f12097a6a39738d0fe5e1b3fad7694bcdeafc7df05296: Status 404 returned error can't find the container with id 2bec25dede6a10e2618f12097a6a39738d0fe5e1b3fad7694bcdeafc7df05296 Jul 21 18:30:50.185774 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.185753 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n54cs"] Jul 21 18:30:50.186805 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.186780 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp"] Jul 21 18:30:50.201142 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.201116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:50.201261 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.201172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:50.201324 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.201245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:50.201324 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201288 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.201265245 +0000 UTC m=+37.134903630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : configmap references non-existent config key: service-ca.crt Jul 21 18:30:50.201324 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201317 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 18:30:50.201479 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201360 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls podName:55118b09-cb92-4ba4-a0fd-3a1c350fe03a nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.201349061 +0000 UTC m=+37.134987462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4tskk" (UID: "55118b09-cb92-4ba4-a0fd-3a1c350fe03a") : secret "samples-operator-tls" not found Jul 21 18:30:50.201479 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201358 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:50.201479 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.201386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:50.201479 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201415 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls podName:ecd290ce-81cb-4e9b-8f87-1adb3f55df0e nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.201399222 +0000 UTC m=+37.135037601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqsd4" (UID: "ecd290ce-81cb-4e9b-8f87-1adb3f55df0e") : secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:50.201479 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201445 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 18:30:50.201479 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201453 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b6775fc7-h8brm: secret "image-registry-tls" not found Jul 21 18:30:50.201728 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.201480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:50.201728 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201506 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls podName:563dcd7d-5673-4890-b407-178d6f04ee11 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.201490212 +0000 UTC m=+37.135128597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls") pod "image-registry-77b6775fc7-h8brm" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11") : secret "image-registry-tls" not found Jul 21 18:30:50.201728 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201516 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 18:30:50.201728 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.201548 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.20153617 +0000 UTC m=+37.135174542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : secret "router-metrics-certs-default" not found Jul 21 18:30:50.302057 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.302022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:50.302281 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.302245 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 18:30:50.302348 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.302331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls podName:9742bb19-be0c-41fe-8ea6-e4af1161ba5c nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.302309295 +0000 UTC m=+37.235947689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls") pod "dns-default-9hkz5" (UID: "9742bb19-be0c-41fe-8ea6-e4af1161ba5c") : secret "dns-default-metrics-tls" not found Jul 21 18:30:50.402820 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.402776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:50.403016 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.402963 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 18:30:50.403109 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:50.403046 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert podName:5f0ed91a-e26b-4baa-ac66-6024848db838 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:51.403024518 +0000 UTC m=+37.336662891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v729j" (UID: "5f0ed91a-e26b-4baa-ac66-6024848db838") : secret "networking-console-plugin-cert" not found Jul 21 18:30:50.555699 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.555622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:30:50.556323 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.555712 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:30:50.556323 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.555845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:30:50.559314 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.559292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 18:30:50.559433 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.559340 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mgcmw\"" Jul 21 18:30:50.559711 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.559696 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 18:30:50.560004 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.559980 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2r4n\"" Jul 21 18:30:50.742409 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.742337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n54cs" event={"ID":"2387f71e-ff4d-459c-a1f9-ca28a78e1800","Type":"ContainerStarted","Data":"2bec25dede6a10e2618f12097a6a39738d0fe5e1b3fad7694bcdeafc7df05296"} Jul 21 18:30:50.745342 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.745278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" event={"ID":"418fa088-8dc7-49be-af50-5dae49b6dad6","Type":"ContainerStarted","Data":"411c4ae0203cab693046d357e061d0087fc9025c49ab845c945af947b9a80a8f"} Jul 21 18:30:50.747250 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.747222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" event={"ID":"4527c326-62ce-4224-94e6-f4f8f85be296","Type":"ContainerStarted","Data":"3286278f1d80f08127166e6a3db82d146bcbc46887ffd3c31469ff12a319656a"} Jul 21 18:30:50.749532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.749511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" event={"ID":"4247d7cb-61b6-44e1-afa6-57876b5e44a6","Type":"ContainerStarted","Data":"cc593ae9ffe822e14b5cd8c4cd73bdc5c5c54a5fe1660cd787e9001d44da64f4"} Jul 21 18:30:50.751352 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.751289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" event={"ID":"2c110131-b834-4e7d-abb0-c044b1d1fa0f","Type":"ContainerStarted","Data":"836751339c54985eeaa3000f30bf6e317b3d2f58bd72c80f1c1d4fb20d6106da"} Jul 21 18:30:50.754007 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.753948 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" event={"ID":"e5b91385-4133-4ee3-a2f6-71fd7f6d4eed","Type":"ContainerStarted","Data":"3289538c9d94ffb5a4e1be83c1bd99ffd9168833b4022b1e4d31372c32f87c30"} Jul 21 18:30:50.756674 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:50.756617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xl85l" event={"ID":"c3180351-57cd-4a37-a9e8-f9c4b01dde1b","Type":"ContainerStarted","Data":"14f5543ca6a18170e5750943c0575602626adae8ccbc8fc31345e1bc3e46b722"} Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.211970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.212070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.212155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.212221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.212260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.212416 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.21239753 +0000 UTC m=+39.146035905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : configmap references non-existent config key: service-ca.crt Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.212959 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213015 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls podName:55118b09-cb92-4ba4-a0fd-3a1c350fe03a nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.21299895 +0000 UTC m=+39.146637328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4tskk" (UID: "55118b09-cb92-4ba4-a0fd-3a1c350fe03a") : secret "samples-operator-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213075 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213125 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls podName:ecd290ce-81cb-4e9b-8f87-1adb3f55df0e nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.213114245 +0000 UTC m=+39.146752621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqsd4" (UID: "ecd290ce-81cb-4e9b-8f87-1adb3f55df0e") : secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213188 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213199 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b6775fc7-h8brm: secret "image-registry-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213234 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls podName:563dcd7d-5673-4890-b407-178d6f04ee11 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.21322316 +0000 UTC m=+39.146861532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls") pod "image-registry-77b6775fc7-h8brm" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11") : secret "image-registry-tls" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213290 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 18:30:51.213363 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.213320 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.213310634 +0000 UTC m=+39.146949010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : secret "router-metrics-certs-default" not found Jul 21 18:30:51.314375 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.313642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:51.314375 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.313892 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 18:30:51.314375 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.313953 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls podName:9742bb19-be0c-41fe-8ea6-e4af1161ba5c nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.31393466 +0000 UTC m=+39.247573039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls") pod "dns-default-9hkz5" (UID: "9742bb19-be0c-41fe-8ea6-e4af1161ba5c") : secret "dns-default-metrics-tls" not found Jul 21 18:30:51.415416 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:51.414808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:51.415416 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.414972 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 18:30:51.415416 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:51.415034 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert podName:5f0ed91a-e26b-4baa-ac66-6024848db838 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:53.41501535 +0000 UTC m=+39.348653725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v729j" (UID: "5f0ed91a-e26b-4baa-ac66-6024848db838") : secret "networking-console-plugin-cert" not found Jul 21 18:30:53.236532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.236493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.236572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.236623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.236724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.236805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.236990 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237007 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b6775fc7-h8brm: secret "image-registry-tls" not found Jul 21 18:30:53.237079 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237066 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls podName:563dcd7d-5673-4890-b407-178d6f04ee11 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.237046836 +0000 UTC m=+43.170685210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls") pod "image-registry-77b6775fc7-h8brm" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11") : secret "image-registry-tls" not found Jul 21 18:30:53.237447 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237156 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 18:30:53.237447 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237192 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.237181096 +0000 UTC m=+43.170819474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : secret "router-metrics-certs-default" not found Jul 21 18:30:53.237447 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237257 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.2372469 +0000 UTC m=+43.170885274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : configmap references non-existent config key: service-ca.crt Jul 21 18:30:53.237447 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237344 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 18:30:53.237447 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237376 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls podName:55118b09-cb92-4ba4-a0fd-3a1c350fe03a nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.237363972 +0000 UTC m=+43.171002347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4tskk" (UID: "55118b09-cb92-4ba4-a0fd-3a1c350fe03a") : secret "samples-operator-tls" not found Jul 21 18:30:53.237447 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237434 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:53.237710 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.237464 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls podName:ecd290ce-81cb-4e9b-8f87-1adb3f55df0e nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.237453886 +0000 UTC m=+43.171092262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqsd4" (UID: "ecd290ce-81cb-4e9b-8f87-1adb3f55df0e") : secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:53.338443 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.338329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:53.338622 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.338466 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 18:30:53.338622 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.338538 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls podName:9742bb19-be0c-41fe-8ea6-e4af1161ba5c nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.338519979 +0000 UTC m=+43.272158353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls") pod "dns-default-9hkz5" (UID: "9742bb19-be0c-41fe-8ea6-e4af1161ba5c") : secret "dns-default-metrics-tls" not found Jul 21 18:30:53.439500 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:53.439460 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:53.439687 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.439618 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 18:30:53.439687 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:53.439677 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert podName:5f0ed91a-e26b-4baa-ac66-6024848db838 nodeName:}" failed. No retries permitted until 2026-07-21 18:30:57.439662275 +0000 UTC m=+43.373300651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v729j" (UID: "5f0ed91a-e26b-4baa-ac66-6024848db838") : secret "networking-console-plugin-cert" not found Jul 21 18:30:54.422037 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:54.421995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:30:54.505936 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:54.505828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:30:55.037607 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:55.037565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:30:55.100771 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:55.100735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:30:57.274177 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.274117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.274234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.274280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274281 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274349 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b6775fc7-h8brm: secret "image-registry-tls" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274399 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls podName:563dcd7d-5673-4890-b407-178d6f04ee11 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.274384512 +0000 UTC m=+51.208022883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls") pod "image-registry-77b6775fc7-h8brm" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11") : secret "image-registry-tls" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274400 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274325 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274423 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.274404241 +0000 UTC m=+51.208042628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : configmap references non-existent config key: service-ca.crt Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.274327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274457 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.274443052 +0000 UTC m=+51.208081424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : secret "router-metrics-certs-default" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274477 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls podName:55118b09-cb92-4ba4-a0fd-3a1c350fe03a nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.274470475 +0000 UTC m=+51.208108846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4tskk" (UID: "55118b09-cb92-4ba4-a0fd-3a1c350fe03a") : secret "samples-operator-tls" not found Jul 21 18:30:57.274614 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.274537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:30:57.275058 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274647 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:57.275058 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.274676 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls podName:ecd290ce-81cb-4e9b-8f87-1adb3f55df0e nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.274669613 +0000 UTC m=+51.208307985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqsd4" (UID: "ecd290ce-81cb-4e9b-8f87-1adb3f55df0e") : secret "cluster-monitoring-operator-tls" not found Jul 21 18:30:57.375922 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.375881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:30:57.376126 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.376048 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 18:30:57.376181 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.376138 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls podName:9742bb19-be0c-41fe-8ea6-e4af1161ba5c nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.37611776 +0000 UTC m=+51.309756133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls") pod "dns-default-9hkz5" (UID: "9742bb19-be0c-41fe-8ea6-e4af1161ba5c") : secret "dns-default-metrics-tls" not found Jul 21 18:30:57.476453 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:57.476419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:30:57.476590 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.476571 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 18:30:57.476659 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:30:57.476649 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert podName:5f0ed91a-e26b-4baa-ac66-6024848db838 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.476627102 +0000 UTC m=+51.410265476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v729j" (UID: "5f0ed91a-e26b-4baa-ac66-6024848db838") : secret "networking-console-plugin-cert" not found Jul 21 18:30:58.793153 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:58.793111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:30:58.851240 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:30:58.851200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:00.791825 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.791787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n54cs" event={"ID":"2387f71e-ff4d-459c-a1f9-ca28a78e1800","Type":"ContainerStarted","Data":"d5571621156a69f1394479f54e973c85c83d504c9dea79c8f3e5871ae612e6b4"} Jul 21 18:31:00.794829 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.794793 2565 generic.go:356] "Generic (PLEG): container finished" podID="63b6f525-5045-42af-bba6-e33a7ab072b1" containerID="434984e9d8fb8f361e1f8bf75e49d24d1fb3bc0b5d1539082f36578e03e785d2" exitCode=0 Jul 21 18:31:00.794967 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.794868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerDied","Data":"434984e9d8fb8f361e1f8bf75e49d24d1fb3bc0b5d1539082f36578e03e785d2"} Jul 21 18:31:00.796817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.796764 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" event={"ID":"418fa088-8dc7-49be-af50-5dae49b6dad6","Type":"ContainerStarted","Data":"deba2bc65d64758ff8f74da9ac05c0d9eaaaf1452c8137e354628db48a5c4403"} Jul 21 18:31:00.798986 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.798958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" event={"ID":"4527c326-62ce-4224-94e6-f4f8f85be296","Type":"ContainerStarted","Data":"bb54d96e621dd2bc55f3ea820715a3c2d8e6df63f4c45e6600998a95aa4ccc7b"} Jul 21 18:31:00.803261 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.802670 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/0.log" Jul 21 18:31:00.803261 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.802711 2565 generic.go:356] "Generic (PLEG): container finished" podID="4247d7cb-61b6-44e1-afa6-57876b5e44a6" containerID="9c25fca84f60026e076af1396dadf31d82fb4f196447a5bbf5db1281f8e7bb7e" exitCode=255 Jul 21 18:31:00.803261 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.802784 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" event={"ID":"4247d7cb-61b6-44e1-afa6-57876b5e44a6","Type":"ContainerDied","Data":"9c25fca84f60026e076af1396dadf31d82fb4f196447a5bbf5db1281f8e7bb7e"} Jul 21 18:31:00.803261 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.803002 2565 scope.go:117] "RemoveContainer" containerID="9c25fca84f60026e076af1396dadf31d82fb4f196447a5bbf5db1281f8e7bb7e" Jul 21 18:31:00.805392 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.805368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" event={"ID":"2c110131-b834-4e7d-abb0-c044b1d1fa0f","Type":"ContainerStarted","Data":"c9d47ad0c05ffaae640b36fffcf89e5ac42f30a12d389faeaa63fd7d3b4bb2a6"} Jul 21 18:31:00.807037 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.807014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" event={"ID":"e5b91385-4133-4ee3-a2f6-71fd7f6d4eed","Type":"ContainerStarted","Data":"70bed11c21deba34177513a16541b0b9a95604cbae49364aabca8abd30b4fdd0"} Jul 21 18:31:00.809420 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.809399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xl85l" event={"ID":"c3180351-57cd-4a37-a9e8-f9c4b01dde1b","Type":"ContainerStarted","Data":"7b3bbad7cb180293cb439a63452cb4b52f82107b607b1259c246217430888617"} Jul 21 18:31:00.811584 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.811530 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n54cs" podStartSLOduration=2.152762708 podStartE2EDuration="11.811515182s" totalImagesPullingTime="9.658752474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:00.810451631 +0000 UTC m=+46.744090024" watchObservedRunningTime="2026-07-21 18:31:00.811515182 +0000 UTC m=+46.745153579" Jul 21 18:31:00.867825 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.867218 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" podStartSLOduration=34.154873827 podStartE2EDuration="43.867194625s" totalImagesPullingTime="9.712320798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:00.866465667 +0000 UTC m=+46.800104062" watchObservedRunningTime="2026-07-21 18:31:00.867194625 +0000 UTC m=+46.800833020" Jul 21 18:31:00.921838 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.921784 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-6psgp" podStartSLOduration=34.025487333 podStartE2EDuration="43.92176205s" totalImagesPullingTime="9.896274717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:00.919683651 +0000 UTC m=+46.853322048" watchObservedRunningTime="2026-07-21 18:31:00.92176205 +0000 UTC m=+46.855400445" Jul 21 18:31:00.941882 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.941827 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-xl85l" podStartSLOduration=34.203788095 podStartE2EDuration="43.941811408s" totalImagesPullingTime="9.738023313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:00.941074163 +0000 UTC m=+46.874712558" watchObservedRunningTime="2026-07-21 18:31:00.941811408 +0000 UTC m=+46.875449796" Jul 21 18:31:00.967331 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.965772 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" podStartSLOduration=34.245531266 podStartE2EDuration="43.965751477s" totalImagesPullingTime="9.720220211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:00.965032776 +0000 UTC m=+46.898671170" watchObservedRunningTime="2026-07-21 18:31:00.965751477 +0000 UTC m=+46.899389872" Jul 21 18:31:00.997406 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:00.996469 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lpzvp" podStartSLOduration=34.322944254 podStartE2EDuration="43.996445951s" totalImagesPullingTime="9.673501697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:00.995181968 +0000 UTC m=+46.928820374" watchObservedRunningTime="2026-07-21 18:31:00.996445951 +0000 UTC m=+46.930084348" Jul 21 18:31:01.102892 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.102807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:01.206017 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.205984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:01.331451 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.331350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:01.436648 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.436604 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:01.539210 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.539154 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xvv2l"] Jul 21 18:31:01.555017 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.554983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.558245 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.558151 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xvv2l"] Jul 21 18:31:01.558708 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.558689 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 18:31:01.559116 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.558838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-98l98\"" Jul 21 18:31:01.559235 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.558916 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 18:31:01.617733 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.617645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/853c902a-f290-432c-a097-4233d9340ad0-crio-socket\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.617889 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.617777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.617949 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.617895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxvn\" (UniqueName: \"kubernetes.io/projected/853c902a-f290-432c-a097-4233d9340ad0-kube-api-access-lxxvn\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.617998 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.617970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.618034 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.618001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/853c902a-f290-432c-a097-4233d9340ad0-data-volume\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718459 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxvn\" (UniqueName: \"kubernetes.io/projected/853c902a-f290-432c-a097-4233d9340ad0-kube-api-access-lxxvn\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718636 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718636 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/853c902a-f290-432c-a097-4233d9340ad0-data-volume\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718636 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:01.718605 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 18:31:01.718792 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/853c902a-f290-432c-a097-4233d9340ad0-crio-socket\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718792 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:01.718682 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:02.218659493 +0000 UTC m=+48.152297868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : configmap "kube-rbac-proxy" not found Jul 21 18:31:01.718792 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/853c902a-f290-432c-a097-4233d9340ad0-crio-socket\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718947 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.718947 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.718851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/853c902a-f290-432c-a097-4233d9340ad0-data-volume\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.719013 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:01.718975 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 18:31:01.719042 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:01.719035 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:02.219018625 +0000 UTC m=+48.152656997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : secret "insights-runtime-extractor-tls" not found Jul 21 18:31:01.731278 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.731238 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxvn\" (UniqueName: \"kubernetes.io/projected/853c902a-f290-432c-a097-4233d9340ad0-kube-api-access-lxxvn\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:01.816820 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.816787 2565 generic.go:356] "Generic (PLEG): container finished" podID="63b6f525-5045-42af-bba6-e33a7ab072b1" containerID="5c9809a279af7c44a65275dca6ea37f6384b4f8a4ce4fb876ed847ede09e2647" exitCode=0 Jul 21 18:31:01.817308 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.816866 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerDied","Data":"5c9809a279af7c44a65275dca6ea37f6384b4f8a4ce4fb876ed847ede09e2647"} Jul 21 18:31:01.818542 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.818521 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:31:01.818936 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.818923 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/0.log" Jul 21 18:31:01.819003 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.818953 2565 generic.go:356] "Generic (PLEG): container finished" podID="4247d7cb-61b6-44e1-afa6-57876b5e44a6" containerID="7f5ec397a1a00d7553803bdaa3b6cd0252db26538944912b14388d6a4d45613a" exitCode=255 Jul 21 18:31:01.819110 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.819059 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" event={"ID":"4247d7cb-61b6-44e1-afa6-57876b5e44a6","Type":"ContainerDied","Data":"7f5ec397a1a00d7553803bdaa3b6cd0252db26538944912b14388d6a4d45613a"} Jul 21 18:31:01.819174 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.819142 2565 scope.go:117] "RemoveContainer" containerID="9c25fca84f60026e076af1396dadf31d82fb4f196447a5bbf5db1281f8e7bb7e" Jul 21 18:31:01.819413 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:01.819392 2565 scope.go:117] "RemoveContainer" containerID="7f5ec397a1a00d7553803bdaa3b6cd0252db26538944912b14388d6a4d45613a" Jul 21 18:31:01.819591 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:01.819561 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hgfk5_openshift-console-operator(4247d7cb-61b6-44e1-afa6-57876b5e44a6)\"" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" podUID="4247d7cb-61b6-44e1-afa6-57876b5e44a6" Jul 21 18:31:02.202014 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.201926 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6"] Jul 21 18:31:02.223105 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.223065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:02.223278 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:02.223192 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 18:31:02.223278 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.223208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:02.223278 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:02.223256 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:03.22324112 +0000 UTC m=+49.156879494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : configmap "kube-rbac-proxy" not found Jul 21 18:31:02.223453 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:02.223319 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 18:31:02.223453 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:02.223369 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:03.223353466 +0000 UTC m=+49.156991841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : secret "insights-runtime-extractor-tls" not found Jul 21 18:31:02.225195 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.225164 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6"] Jul 21 18:31:02.225326 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.225289 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" Jul 21 18:31:02.228301 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.228280 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6xxhs\"" Jul 21 18:31:02.228470 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.228449 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 21 18:31:02.228629 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.228614 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 21 18:31:02.324273 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.324234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75x9\" (UniqueName: \"kubernetes.io/projected/199b7b74-a0bd-48b3-9373-65b8d7e2733f-kube-api-access-x75x9\") pod \"migrator-7cc9c7ffd7-2vgt6\" (UID: \"199b7b74-a0bd-48b3-9373-65b8d7e2733f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" Jul 21 18:31:02.425599 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.425560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x75x9\" (UniqueName: \"kubernetes.io/projected/199b7b74-a0bd-48b3-9373-65b8d7e2733f-kube-api-access-x75x9\") pod \"migrator-7cc9c7ffd7-2vgt6\" (UID: \"199b7b74-a0bd-48b3-9373-65b8d7e2733f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" Jul 21 18:31:02.435794 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.435760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75x9\" (UniqueName: \"kubernetes.io/projected/199b7b74-a0bd-48b3-9373-65b8d7e2733f-kube-api-access-x75x9\") pod \"migrator-7cc9c7ffd7-2vgt6\" (UID: \"199b7b74-a0bd-48b3-9373-65b8d7e2733f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" Jul 21 18:31:02.534582 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.534543 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" Jul 21 18:31:02.690321 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.689355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6"] Jul 21 18:31:02.692976 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:02.692940 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199b7b74_a0bd_48b3_9373_65b8d7e2733f.slice/crio-aeaad78052e96b6eb6d12e529d5be0e694414e34ac303bce3937f6d98964a725 WatchSource:0}: Error finding container aeaad78052e96b6eb6d12e529d5be0e694414e34ac303bce3937f6d98964a725: Status 404 returned error can't find the container with id aeaad78052e96b6eb6d12e529d5be0e694414e34ac303bce3937f6d98964a725 Jul 21 18:31:02.824151 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.824061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" event={"ID":"199b7b74-a0bd-48b3-9373-65b8d7e2733f","Type":"ContainerStarted","Data":"aeaad78052e96b6eb6d12e529d5be0e694414e34ac303bce3937f6d98964a725"} Jul 21 18:31:02.827377 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.827344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps6j" event={"ID":"63b6f525-5045-42af-bba6-e33a7ab072b1","Type":"ContainerStarted","Data":"b6449283b324d8f62aef1ced80a76853fd7f536dff15652d3cefe4cd1d7b7369"} Jul 21 18:31:02.828984 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.828965 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:31:02.829266 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.829252 2565 scope.go:117] "RemoveContainer" containerID="7f5ec397a1a00d7553803bdaa3b6cd0252db26538944912b14388d6a4d45613a" Jul 21 18:31:02.829393 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:02.829378 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hgfk5_openshift-console-operator(4247d7cb-61b6-44e1-afa6-57876b5e44a6)\"" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" podUID="4247d7cb-61b6-44e1-afa6-57876b5e44a6" Jul 21 18:31:02.872257 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.872211 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fps6j" podStartSLOduration=9.552169427 podStartE2EDuration="48.87219576s" totalImagesPullingTime="39.320026333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:02.870985369 +0000 UTC m=+48.804623762" watchObservedRunningTime="2026-07-21 18:31:02.87219576 +0000 UTC m=+48.805834150" Jul 21 18:31:02.932512 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:02.932484 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd2z9_f86889d0-703b-43e8-b66e-5fe7a3632535/dns-node-resolver/0.log" Jul 21 18:31:03.136472 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.136390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:03.233236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.233200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:03.233416 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.233327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:03.233416 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:03.233362 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 18:31:03.233485 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:03.233416 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 18:31:03.233485 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:03.233428 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.233412836 +0000 UTC m=+51.167051279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : secret "insights-runtime-extractor-tls" not found Jul 21 18:31:03.233485 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:03.233456 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:05.233444358 +0000 UTC m=+51.167082730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : configmap "kube-rbac-proxy" not found Jul 21 18:31:03.244452 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.244408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:03.396312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.396220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:03.494804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.494770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:03.730804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.730717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dm9tm_95748c1a-496b-46c0-9d7f-eac96cafda55/node-ca/0.log" Jul 21 18:31:03.983794 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:03.983654 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:04.082607 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.082558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:04.215134 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.215062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:04.227996 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.227963 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9pg5k"] Jul 21 18:31:04.239975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.239912 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.242067 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.242038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9pg5k"] Jul 21 18:31:04.243609 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.243587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 21 18:31:04.243739 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.243657 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 21 18:31:04.244321 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.244289 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 21 18:31:04.244436 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.244292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8gl7z\"" Jul 21 18:31:04.244602 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.244572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 21 18:31:04.334115 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.334066 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n54cs_2387f71e-ff4d-459c-a1f9-ca28a78e1800/serve-healthcheck-canary/0.log" Jul 21 18:31:04.334334 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.334311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:04.344351 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.344323 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1269183b-6f36-4760-bf4e-2aa00c511a11-signing-key\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.344515 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.344362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1269183b-6f36-4760-bf4e-2aa00c511a11-signing-cabundle\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.344515 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.344428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg2ss\" (UniqueName: \"kubernetes.io/projected/1269183b-6f36-4760-bf4e-2aa00c511a11-kube-api-access-gg2ss\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.436391 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.436365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:04.445427 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.445404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1269183b-6f36-4760-bf4e-2aa00c511a11-signing-key\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.445527 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.445435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1269183b-6f36-4760-bf4e-2aa00c511a11-signing-cabundle\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.445527 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.445467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg2ss\" (UniqueName: \"kubernetes.io/projected/1269183b-6f36-4760-bf4e-2aa00c511a11-kube-api-access-gg2ss\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.446165 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.446080 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1269183b-6f36-4760-bf4e-2aa00c511a11-signing-cabundle\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.447859 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.447838 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1269183b-6f36-4760-bf4e-2aa00c511a11-signing-key\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.455327 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.455308 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg2ss\" (UniqueName: \"kubernetes.io/projected/1269183b-6f36-4760-bf4e-2aa00c511a11-kube-api-access-gg2ss\") pod \"service-ca-58598695f7-9pg5k\" (UID: \"1269183b-6f36-4760-bf4e-2aa00c511a11\") " pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.550180 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.550150 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9pg5k" Jul 21 18:31:04.718627 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.718595 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9pg5k"] Jul 21 18:31:04.721653 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:04.721626 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1269183b_6f36_4760_bf4e_2aa00c511a11.slice/crio-f2ab7ac7949a937d8d840a275d0e0d2547b81bacf9d45c967cf2a57abbdb7080 WatchSource:0}: Error finding container f2ab7ac7949a937d8d840a275d0e0d2547b81bacf9d45c967cf2a57abbdb7080: Status 404 returned error can't find the container with id f2ab7ac7949a937d8d840a275d0e0d2547b81bacf9d45c967cf2a57abbdb7080 Jul 21 18:31:04.810639 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.810606 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:04.838558 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.838518 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" event={"ID":"199b7b74-a0bd-48b3-9373-65b8d7e2733f","Type":"ContainerStarted","Data":"3685e840df97c342c313803abdc5df0b3b7d7be13c7954e07340a537026a1088"} Jul 21 18:31:04.838730 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.838587 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" event={"ID":"199b7b74-a0bd-48b3-9373-65b8d7e2733f","Type":"ContainerStarted","Data":"1d9ffb8214fb860b4816ad8086a621d782e546039a5a51b042fa8aae406be0c7"} Jul 21 18:31:04.840017 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.839993 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9pg5k" event={"ID":"1269183b-6f36-4760-bf4e-2aa00c511a11","Type":"ContainerStarted","Data":"ad767d7e276d9303dede54f7078c72c4d548e6d9a67cfbcee1f1687c20697e2b"} Jul 21 18:31:04.840143 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.840033 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9pg5k" event={"ID":"1269183b-6f36-4760-bf4e-2aa00c511a11","Type":"ContainerStarted","Data":"f2ab7ac7949a937d8d840a275d0e0d2547b81bacf9d45c967cf2a57abbdb7080"} Jul 21 18:31:04.878707 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.878652 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-2vgt6" podStartSLOduration=1.283750441 podStartE2EDuration="2.878633749s" totalImagesPullingTime="1.594883308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:04.878557383 +0000 UTC m=+50.812195777" watchObservedRunningTime="2026-07-21 18:31:04.878633749 +0000 UTC m=+50.812272122" Jul 21 18:31:04.942171 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:04.942132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:05.073623 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.073538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:05.181104 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.181057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:05.252236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.252194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:05.252386 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.252314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:05.252386 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.252334 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 18:31:05.252476 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.252402 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:09.252381106 +0000 UTC m=+55.186019480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : configmap "kube-rbac-proxy" not found Jul 21 18:31:05.252520 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.252469 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 18:31:05.252583 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.252572 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:09.252554648 +0000 UTC m=+55.186193021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : secret "insights-runtime-extractor-tls" not found Jul 21 18:31:05.353150 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.353049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:05.353290 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.353149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:31:05.353290 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353223 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.353206686 +0000 UTC m=+67.286845059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : configmap references non-existent config key: service-ca.crt Jul 21 18:31:05.353290 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.353250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:31:05.353431 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.353320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:31:05.353431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353324 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 18:31:05.353431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353386 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls podName:55118b09-cb92-4ba4-a0fd-3a1c350fe03a nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.353369669 +0000 UTC m=+67.287008045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-4tskk" (UID: "55118b09-cb92-4ba4-a0fd-3a1c350fe03a") : secret "samples-operator-tls" not found Jul 21 18:31:05.353431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353383 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 18:31:05.353431 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353426 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 18:31:05.353606 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353434 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls podName:ecd290ce-81cb-4e9b-8f87-1adb3f55df0e nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.353421522 +0000 UTC m=+67.287059894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-pqsd4" (UID: "ecd290ce-81cb-4e9b-8f87-1adb3f55df0e") : secret "cluster-monitoring-operator-tls" not found Jul 21 18:31:05.353606 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353438 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b6775fc7-h8brm: secret "image-registry-tls" not found Jul 21 18:31:05.353606 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353478 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls podName:563dcd7d-5673-4890-b407-178d6f04ee11 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.353466755 +0000 UTC m=+67.287105129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls") pod "image-registry-77b6775fc7-h8brm" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11") : secret "image-registry-tls" not found Jul 21 18:31:05.353606 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353487 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 18:31:05.353606 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.353432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:05.353606 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.353518 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs podName:92b73819-48f9-42a1-817a-813c899b1853 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.353508337 +0000 UTC m=+67.287146713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs") pod "router-default-67c9769c8d-svp7r" (UID: "92b73819-48f9-42a1-817a-813c899b1853") : secret "router-metrics-certs-default" not found Jul 21 18:31:05.388165 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.388128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:05.454368 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.454330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:31:05.454541 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.454486 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 18:31:05.454587 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.454557 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls podName:9742bb19-be0c-41fe-8ea6-e4af1161ba5c nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.454537651 +0000 UTC m=+67.388176026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls") pod "dns-default-9hkz5" (UID: "9742bb19-be0c-41fe-8ea6-e4af1161ba5c") : secret "dns-default-metrics-tls" not found Jul 21 18:31:05.555615 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.555575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:31:05.555789 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.555734 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 18:31:05.555846 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:05.555797 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert podName:5f0ed91a-e26b-4baa-ac66-6024848db838 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:21.55578178 +0000 UTC m=+67.489420155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-v729j" (UID: "5f0ed91a-e26b-4baa-ac66-6024848db838") : secret "networking-console-plugin-cert" not found Jul 21 18:31:05.581333 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.581295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:05.682620 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.682534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:05.860767 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:05.860714 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-9pg5k" podStartSLOduration=1.8606968149999998 podStartE2EDuration="1.860696815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:05.860199642 +0000 UTC m=+51.793838040" watchObservedRunningTime="2026-07-21 18:31:05.860696815 +0000 UTC m=+51.794335209" Jul 21 18:31:06.351563 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:06.351533 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:06.451182 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:06.450970 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:06.554373 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:06.554338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:06.659157 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:06.659051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:06.772660 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:06.772625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:07.101823 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:07.101791 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:07.886517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:07.886481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:08.469139 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:08.469102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:08.689731 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:08.689693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:08.827494 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:08.827454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:09.108901 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.108814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:09.293346 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.293304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:09.293599 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.293410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:09.293599 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:09.293582 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 18:31:09.293671 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:09.293646 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls podName:853c902a-f290-432c-a097-4233d9340ad0 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:17.293629684 +0000 UTC m=+63.227268061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xvv2l" (UID: "853c902a-f290-432c-a097-4233d9340ad0") : secret "insights-runtime-extractor-tls" not found Jul 21 18:31:09.293980 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.293959 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c902a-f290-432c-a097-4233d9340ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:09.325238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.325200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:09.680624 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.680591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:09.833002 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.832961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:09.856666 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.856634 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:31:09.856837 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.856710 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:31:09.857080 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:09.857067 2565 scope.go:117] "RemoveContainer" containerID="7f5ec397a1a00d7553803bdaa3b6cd0252db26538944912b14388d6a4d45613a" Jul 21 18:31:09.857257 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:09.857238 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-hgfk5_openshift-console-operator(4247d7cb-61b6-44e1-afa6-57876b5e44a6)\"" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" podUID="4247d7cb-61b6-44e1-afa6-57876b5e44a6" Jul 21 18:31:10.258374 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:10.258336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:10.654661 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:10.654576 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:10.863749 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:10.863718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:11.097930 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:11.097893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:11.497671 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:11.497583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:11.626542 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:11.626512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:11.734768 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:11.734733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:13.467647 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:13.467605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:13.591619 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:13.591589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:13.685348 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:13.685316 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:13.851204 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:13.851172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:13.928049 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:13.928014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:14.444606 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:14.444570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:14.648902 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:14.648871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:15.041662 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:15.041633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:15.242999 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:15.242956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:15.735241 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:15.735218 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcnjr" Jul 21 18:31:15.863402 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:15.863374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:17.372971 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.372926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:17.375381 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.375352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c902a-f290-432c-a097-4233d9340ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xvv2l\" (UID: \"853c902a-f290-432c-a097-4233d9340ad0\") " pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:17.469749 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.469716 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-98l98\"" Jul 21 18:31:17.477975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.477933 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xvv2l" Jul 21 18:31:17.570857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.570823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:17.613276 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.613243 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xvv2l"] Jul 21 18:31:17.616700 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:17.616671 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853c902a_f290_432c_a097_4233d9340ad0.slice/crio-1492dbb6d9754c8c0fe0103ca505b5a421f148e63b22b5c3b0cc357f5de85124 WatchSource:0}: Error finding container 1492dbb6d9754c8c0fe0103ca505b5a421f148e63b22b5c3b0cc357f5de85124: Status 404 returned error can't find the container with id 1492dbb6d9754c8c0fe0103ca505b5a421f148e63b22b5c3b0cc357f5de85124 Jul 21 18:31:17.674906 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.674825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:17.881755 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:17.881723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvv2l" event={"ID":"853c902a-f290-432c-a097-4233d9340ad0","Type":"ContainerStarted","Data":"1492dbb6d9754c8c0fe0103ca505b5a421f148e63b22b5c3b0cc357f5de85124"} Jul 21 18:31:20.089968 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.089936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:20.176274 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.176240 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:20.201545 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.201502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:31:20.204670 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.204641 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 18:31:20.214611 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.214585 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25cd6f50-f464-49ae-a833-6eafeb473291-metrics-certs\") pod \"network-metrics-daemon-zfx75\" (UID: \"25cd6f50-f464-49ae-a833-6eafeb473291\") " pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:31:20.279503 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.279476 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mgcmw\"" Jul 21 18:31:20.287743 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.287704 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zfx75" Jul 21 18:31:20.302298 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.302265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:31:20.302457 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.302367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:31:20.305422 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.305196 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 18:31:20.305562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.305445 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnsm9\" (UniqueName: \"kubernetes.io/projected/acf3797e-b0ff-4e5a-b0f8-eca8ba970770-kube-api-access-pnsm9\") pod \"network-check-target-2656j\" (UID: \"acf3797e-b0ff-4e5a-b0f8-eca8ba970770\") " pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:31:20.315321 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.315290 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad-original-pull-secret\") pod \"global-pull-secret-syncer-6d7dw\" (UID: \"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad\") " pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:31:20.567285 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.567253 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6d7dw" Jul 21 18:31:20.575437 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.575411 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v2r4n\"" Jul 21 18:31:20.583756 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:20.583721 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:31:21.413580 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.413526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:31:21.414125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.413622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:21.414125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.413660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:21.414125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.413694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:31:21.414125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.413751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:31:21.414537 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.414515 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b73819-48f9-42a1-817a-813c899b1853-service-ca-bundle\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:21.416631 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.416608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ecd290ce-81cb-4e9b-8f87-1adb3f55df0e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-pqsd4\" (UID: \"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:31:21.416766 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.416743 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92b73819-48f9-42a1-817a-813c899b1853-metrics-certs\") pod \"router-default-67c9769c8d-svp7r\" (UID: \"92b73819-48f9-42a1-817a-813c899b1853\") " pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:21.416816 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.416793 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/55118b09-cb92-4ba4-a0fd-3a1c350fe03a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-4tskk\" (UID: \"55118b09-cb92-4ba4-a0fd-3a1c350fe03a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:31:21.417476 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.417457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"image-registry-77b6775fc7-h8brm\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:31:21.514818 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.514769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:31:21.517416 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.517390 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9742bb19-be0c-41fe-8ea6-e4af1161ba5c-metrics-tls\") pod \"dns-default-9hkz5\" (UID: \"9742bb19-be0c-41fe-8ea6-e4af1161ba5c\") " pod="openshift-dns/dns-default-9hkz5" Jul 21 18:31:21.581450 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.581411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:21.592377 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.592348 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8lj5b\"" Jul 21 18:31:21.593860 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.593840 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kjmkt\"" Jul 21 18:31:21.597152 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.597126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:31:21.602295 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.602269 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" Jul 21 18:31:21.616063 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.616034 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:31:21.618847 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.618824 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n5cs6\"" Jul 21 18:31:21.618962 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.618864 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0ed91a-e26b-4baa-ac66-6024848db838-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-v729j\" (UID: \"5f0ed91a-e26b-4baa-ac66-6024848db838\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:31:21.626245 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.626226 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:21.653793 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.653766 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hk5r5\"" Jul 21 18:31:21.660200 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.660178 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" Jul 21 18:31:21.698382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.698351 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwq42\"" Jul 21 18:31:21.706588 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.706558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9hkz5" Jul 21 18:31:21.746121 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.746058 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-njwcm\"" Jul 21 18:31:21.753811 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:21.753787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" Jul 21 18:31:22.432944 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:22.432909 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk"] Jul 21 18:31:22.903271 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:22.903224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" event={"ID":"55118b09-cb92-4ba4-a0fd-3a1c350fe03a","Type":"ContainerStarted","Data":"ea8ed9e2996a03c1797d6f243fd9e2a88440a44bc6910065f98c8b3149cfe1a6"} Jul 21 18:31:22.921835 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:22.921747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-v729j"] Jul 21 18:31:22.925978 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:22.925442 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zfx75"] Jul 21 18:31:22.928239 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:22.928205 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0ed91a_e26b_4baa_ac66_6024848db838.slice/crio-cfb5dcec4734560b66683c9232edc0d7b9c83217d880c590b7cbaab7374b30e3 WatchSource:0}: Error finding container cfb5dcec4734560b66683c9232edc0d7b9c83217d880c590b7cbaab7374b30e3: Status 404 returned error can't find the container with id cfb5dcec4734560b66683c9232edc0d7b9c83217d880c590b7cbaab7374b30e3 Jul 21 18:31:22.960362 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:22.960327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4"] Jul 21 18:31:22.965607 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:22.965554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd290ce_81cb_4e9b_8f87_1adb3f55df0e.slice/crio-0ede3c8141bb8e43837b68f298fa976e352b1b0bc62979132c8ea0b9b476aa6c WatchSource:0}: Error finding container 0ede3c8141bb8e43837b68f298fa976e352b1b0bc62979132c8ea0b9b476aa6c: Status 404 returned error can't find the container with id 0ede3c8141bb8e43837b68f298fa976e352b1b0bc62979132c8ea0b9b476aa6c Jul 21 18:31:22.990894 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:22.990761 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9hkz5"] Jul 21 18:31:22.993437 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:22.993408 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9742bb19_be0c_41fe_8ea6_e4af1161ba5c.slice/crio-fcd5d404d101b6ed329afea883676f1cce9ed3cbe2ad35487b8e5298659134e5 WatchSource:0}: Error finding container fcd5d404d101b6ed329afea883676f1cce9ed3cbe2ad35487b8e5298659134e5: Status 404 returned error can't find the container with id fcd5d404d101b6ed329afea883676f1cce9ed3cbe2ad35487b8e5298659134e5 Jul 21 18:31:23.208872 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.208799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6d7dw"] Jul 21 18:31:23.211355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.211331 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2656j"] Jul 21 18:31:23.212179 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:23.212003 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781c4cdf_7ae7_4a7b_9cc8_efa29a22b3ad.slice/crio-5dc720180e022d041b6841e090b12ce3efcdd9edef3e1823176e098d4242a1b5 WatchSource:0}: Error finding container 5dc720180e022d041b6841e090b12ce3efcdd9edef3e1823176e098d4242a1b5: Status 404 returned error can't find the container with id 5dc720180e022d041b6841e090b12ce3efcdd9edef3e1823176e098d4242a1b5 Jul 21 18:31:23.213821 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:23.213806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf3797e_b0ff_4e5a_b0f8_eca8ba970770.slice/crio-daf1c65366b2b1be7a8967e78944fef0cb9a04e55fc928bf5ef4c83d07d41716 WatchSource:0}: Error finding container daf1c65366b2b1be7a8967e78944fef0cb9a04e55fc928bf5ef4c83d07d41716: Status 404 returned error can't find the container with id daf1c65366b2b1be7a8967e78944fef0cb9a04e55fc928bf5ef4c83d07d41716 Jul 21 18:31:23.223345 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.223324 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67c9769c8d-svp7r"] Jul 21 18:31:23.224780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.224760 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b6775fc7-h8brm"] Jul 21 18:31:23.227636 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:23.227611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563dcd7d_5673_4890_b407_178d6f04ee11.slice/crio-73e130a46f76c78847c79128f65000c01fa005df1de56b8c2e2b71c8b9b713d9 WatchSource:0}: Error finding container 73e130a46f76c78847c79128f65000c01fa005df1de56b8c2e2b71c8b9b713d9: Status 404 returned error can't find the container with id 73e130a46f76c78847c79128f65000c01fa005df1de56b8c2e2b71c8b9b713d9 Jul 21 18:31:23.229795 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:23.229770 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b73819_48f9_42a1_817a_813c899b1853.slice/crio-e6a96163cc8e89a0bbd40e001544fb17c7f8d6260202a39b7f1dc0f33e67b3af WatchSource:0}: Error finding container e6a96163cc8e89a0bbd40e001544fb17c7f8d6260202a39b7f1dc0f33e67b3af: Status 404 returned error can't find the container with id e6a96163cc8e89a0bbd40e001544fb17c7f8d6260202a39b7f1dc0f33e67b3af Jul 21 18:31:23.912466 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.912425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67c9769c8d-svp7r" event={"ID":"92b73819-48f9-42a1-817a-813c899b1853","Type":"ContainerStarted","Data":"2659a9ab4688275ad89625005ed22e80797b75e1902d0bdc6b7b7d9dc17ea035"} Jul 21 18:31:23.912894 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.912486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67c9769c8d-svp7r" event={"ID":"92b73819-48f9-42a1-817a-813c899b1853","Type":"ContainerStarted","Data":"e6a96163cc8e89a0bbd40e001544fb17c7f8d6260202a39b7f1dc0f33e67b3af"} Jul 21 18:31:23.914256 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.914217 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" event={"ID":"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e","Type":"ContainerStarted","Data":"0ede3c8141bb8e43837b68f298fa976e352b1b0bc62979132c8ea0b9b476aa6c"} Jul 21 18:31:23.916035 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.915973 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zfx75" event={"ID":"25cd6f50-f464-49ae-a833-6eafeb473291","Type":"ContainerStarted","Data":"7c66f5c4a5c58ae1dd5c48e93ee4c3ea2c83a183306714710a34ece30455051b"} Jul 21 18:31:23.917879 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.917821 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9hkz5" event={"ID":"9742bb19-be0c-41fe-8ea6-e4af1161ba5c","Type":"ContainerStarted","Data":"fcd5d404d101b6ed329afea883676f1cce9ed3cbe2ad35487b8e5298659134e5"} Jul 21 18:31:23.919366 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.919343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" event={"ID":"5f0ed91a-e26b-4baa-ac66-6024848db838","Type":"ContainerStarted","Data":"cfb5dcec4734560b66683c9232edc0d7b9c83217d880c590b7cbaab7374b30e3"} Jul 21 18:31:23.920992 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.920964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6d7dw" event={"ID":"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad","Type":"ContainerStarted","Data":"5dc720180e022d041b6841e090b12ce3efcdd9edef3e1823176e098d4242a1b5"} Jul 21 18:31:23.923460 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.922887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2656j" event={"ID":"acf3797e-b0ff-4e5a-b0f8-eca8ba970770","Type":"ContainerStarted","Data":"10fef6675fc4e945944dc516e58dba25d12a18774aa6f329b24726246a74e5b1"} Jul 21 18:31:23.923460 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.922930 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2656j" event={"ID":"acf3797e-b0ff-4e5a-b0f8-eca8ba970770","Type":"ContainerStarted","Data":"daf1c65366b2b1be7a8967e78944fef0cb9a04e55fc928bf5ef4c83d07d41716"} Jul 21 18:31:23.923460 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.923429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:31:23.925414 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.925390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvv2l" event={"ID":"853c902a-f290-432c-a097-4233d9340ad0","Type":"ContainerStarted","Data":"e2375f485d8dc1f989d549fb754aa2ccb3e498c07e0d3174985c105205fb3190"} Jul 21 18:31:23.927360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.926841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" event={"ID":"563dcd7d-5673-4890-b407-178d6f04ee11","Type":"ContainerStarted","Data":"740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1"} Jul 21 18:31:23.927360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.926881 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" event={"ID":"563dcd7d-5673-4890-b407-178d6f04ee11","Type":"ContainerStarted","Data":"73e130a46f76c78847c79128f65000c01fa005df1de56b8c2e2b71c8b9b713d9"} Jul 21 18:31:23.927360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.927077 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:31:23.967209 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.967152 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" podStartSLOduration=68.967130585 podStartE2EDuration="1m8.967130585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:23.966584178 +0000 UTC m=+69.900222573" watchObservedRunningTime="2026-07-21 18:31:23.967130585 +0000 UTC m=+69.900768977" Jul 21 18:31:23.968793 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:23.968746 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67c9769c8d-svp7r" podStartSLOduration=66.968728445 podStartE2EDuration="1m6.968728445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:23.941883445 +0000 UTC m=+69.875521841" watchObservedRunningTime="2026-07-21 18:31:23.968728445 +0000 UTC m=+69.902366840" Jul 21 18:31:24.626678 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:24.626582 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:24.634913 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:24.634676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:24.660405 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:24.660242 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2656j" podStartSLOduration=70.660207988 podStartE2EDuration="1m10.660207988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:23.988184977 +0000 UTC m=+69.921823362" watchObservedRunningTime="2026-07-21 18:31:24.660207988 +0000 UTC m=+70.593846382" Jul 21 18:31:24.932576 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:24.932435 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:24.934488 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:24.934457 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67c9769c8d-svp7r" Jul 21 18:31:25.552746 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:25.552718 2565 scope.go:117] "RemoveContainer" containerID="7f5ec397a1a00d7553803bdaa3b6cd0252db26538944912b14388d6a4d45613a" Jul 21 18:31:28.829426 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:28.829392 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:28.928947 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:28.928913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:31.418050 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:31.418012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:32.611868 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:32.611831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:32.972541 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:32.972409 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:31:32.972541 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:32.972485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" event={"ID":"4247d7cb-61b6-44e1-afa6-57876b5e44a6","Type":"ContainerStarted","Data":"37a779cadaa5f38d98c4f227944568084d6c19186d08fc5a138aeb9a388b4188"} Jul 21 18:31:32.975962 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:32.975781 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:31:33.320804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.320781 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" Jul 21 18:31:33.390467 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.390356 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-hgfk5" podStartSLOduration=66.682970066 podStartE2EDuration="1m16.390335428s" totalImagesPullingTime="9.707365362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:33.005861852 +0000 UTC m=+78.939500247" watchObservedRunningTime="2026-07-21 18:31:33.390335428 +0000 UTC m=+79.323973864" Jul 21 18:31:33.660497 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.660415 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-fqvg4"] Jul 21 18:31:33.663255 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.663233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:33.665991 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.665969 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 18:31:33.666556 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.666538 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8tz65\"" Jul 21 18:31:33.666894 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.666879 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 18:31:33.691208 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.691174 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fqvg4"] Jul 21 18:31:33.715532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.715447 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:33.831643 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.831569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7zzq\" (UniqueName: \"kubernetes.io/projected/de20c2bf-713c-4490-bad9-8b4e9a094b61-kube-api-access-z7zzq\") pod \"downloads-5bc67dcd46-fqvg4\" (UID: \"de20c2bf-713c-4490-bad9-8b4e9a094b61\") " pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:33.841002 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.840905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:33.933183 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.933014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7zzq\" (UniqueName: \"kubernetes.io/projected/de20c2bf-713c-4490-bad9-8b4e9a094b61-kube-api-access-z7zzq\") pod \"downloads-5bc67dcd46-fqvg4\" (UID: \"de20c2bf-713c-4490-bad9-8b4e9a094b61\") " pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:33.947380 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.947350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7zzq\" (UniqueName: \"kubernetes.io/projected/de20c2bf-713c-4490-bad9-8b4e9a094b61-kube-api-access-z7zzq\") pod \"downloads-5bc67dcd46-fqvg4\" (UID: \"de20c2bf-713c-4490-bad9-8b4e9a094b61\") " pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:33.957691 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.957659 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv"] Jul 21 18:31:33.960866 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.960827 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:33.961337 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.961320 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:33.964366 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.964184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n2m94\"" Jul 21 18:31:33.964534 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.964517 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 18:31:33.972575 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.972552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:33.979224 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.979197 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv"] Jul 21 18:31:33.981338 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.981309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" event={"ID":"55118b09-cb92-4ba4-a0fd-3a1c350fe03a","Type":"ContainerStarted","Data":"dd40880676fdc21824ccbaf6944bbeb0b5880d992466fea56fed4dc5bc797912"} Jul 21 18:31:33.981432 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.981357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" event={"ID":"55118b09-cb92-4ba4-a0fd-3a1c350fe03a","Type":"ContainerStarted","Data":"26abde1486a5b8b930106dfa7e3d267bdddaae8bc3e01075958f5e678b963b51"} Jul 21 18:31:33.984639 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.984182 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6d7dw" event={"ID":"781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad","Type":"ContainerStarted","Data":"9807fbd0f96aff0ad49491f5e1ca5d2927af57be92eee022173b64d70c38c9fa"} Jul 21 18:31:33.987276 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.987252 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvv2l" event={"ID":"853c902a-f290-432c-a097-4233d9340ad0","Type":"ContainerStarted","Data":"8d9e53418816947ddef9621dcae2bcfcae36134e20e2e582b920bdbd186d0994"} Jul 21 18:31:33.988805 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.988778 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" event={"ID":"ecd290ce-81cb-4e9b-8f87-1adb3f55df0e","Type":"ContainerStarted","Data":"0b8dd49a5d50466fdfa3f261298ef8a7535da5230d72468ba50b2ed28c168f01"} Jul 21 18:31:33.991463 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.991442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zfx75" event={"ID":"25cd6f50-f464-49ae-a833-6eafeb473291","Type":"ContainerStarted","Data":"b67da7df966dec8a913b40824a8b62ca5456286dea9f86a9c9dbf784656114d2"} Jul 21 18:31:33.991562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:33.991487 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zfx75" event={"ID":"25cd6f50-f464-49ae-a833-6eafeb473291","Type":"ContainerStarted","Data":"255928cfb7c0f932c83901e9cbf8c2748922ed6e3fdfc5b48f751185650c83e9"} Jul 21 18:31:34.005554 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.005466 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9hkz5" event={"ID":"9742bb19-be0c-41fe-8ea6-e4af1161ba5c","Type":"ContainerStarted","Data":"38ec743d46195399ac82d06aba3d3c88f8d863e008f107717632452bf2b62730"} Jul 21 18:31:34.005554 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.005553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9hkz5" event={"ID":"9742bb19-be0c-41fe-8ea6-e4af1161ba5c","Type":"ContainerStarted","Data":"ac9fe47ae4c5428cc9ed7c0b29aa4b33222d6c6ea31e4b87fc467f6b23a98502"} Jul 21 18:31:34.006163 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.006072 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9hkz5" Jul 21 18:31:34.009297 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.009275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" event={"ID":"5f0ed91a-e26b-4baa-ac66-6024848db838","Type":"ContainerStarted","Data":"35d453d70b1e9f25cedafe5d66eedf5683eb4769d0f6ea1f886d30f6dab7c502"} Jul 21 18:31:34.036414 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.034707 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-pqsd4" podStartSLOduration=68.112596072 podStartE2EDuration="1m18.03468511s" totalImagesPullingTime="9.922089038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:34.034434631 +0000 UTC m=+79.968073028" watchObservedRunningTime="2026-07-21 18:31:34.03468511 +0000 UTC m=+79.968323505" Jul 21 18:31:34.036414 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.035879 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zfx75" podStartSLOduration=70.560858989 podStartE2EDuration="1m20.035860239s" totalImagesPullingTime="9.47500125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:34.015669737 +0000 UTC m=+79.949308132" watchObservedRunningTime="2026-07-21 18:31:34.035860239 +0000 UTC m=+79.969498633" Jul 21 18:31:34.061717 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.061642 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6d7dw" podStartSLOduration=69.392197053 podStartE2EDuration="1m19.061616668s" totalImagesPullingTime="9.669419615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:34.059371023 +0000 UTC m=+79.993009418" watchObservedRunningTime="2026-07-21 18:31:34.061616668 +0000 UTC m=+79.995255063" Jul 21 18:31:34.081859 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.081760 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-4tskk" podStartSLOduration=69.072213707 podStartE2EDuration="1m17.081736963s" totalImagesPullingTime="8.009523256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:34.080351668 +0000 UTC m=+80.013990061" watchObservedRunningTime="2026-07-21 18:31:34.081736963 +0000 UTC m=+80.015375362" Jul 21 18:31:34.128489 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.128189 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9hkz5" podStartSLOduration=35.700746211 podStartE2EDuration="45.128165235s" totalImagesPullingTime="9.427419024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:34.102074338 +0000 UTC m=+80.035712734" watchObservedRunningTime="2026-07-21 18:31:34.128165235 +0000 UTC m=+80.061803631" Jul 21 18:31:34.128489 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.128440 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-v729j" podStartSLOduration=40.647437734 podStartE2EDuration="50.128426333s" totalImagesPullingTime="9.480988599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:34.127389641 +0000 UTC m=+80.061028038" watchObservedRunningTime="2026-07-21 18:31:34.128426333 +0000 UTC m=+80.062064727" Jul 21 18:31:34.135719 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.134852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60d46f8a-f9b9-448b-8082-3d4197de05a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5qjrv\" (UID: \"60d46f8a-f9b9-448b-8082-3d4197de05a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:34.174490 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.174169 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:34.176428 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.176404 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fqvg4"] Jul 21 18:31:34.181019 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:34.180916 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde20c2bf_713c_4490_bad9_8b4e9a094b61.slice/crio-7ed57faa15ae38b0a0d1a0f9958a74432edd5613d3de3e820df4431c0766b653 WatchSource:0}: Error finding container 7ed57faa15ae38b0a0d1a0f9958a74432edd5613d3de3e820df4431c0766b653: Status 404 returned error can't find the container with id 7ed57faa15ae38b0a0d1a0f9958a74432edd5613d3de3e820df4431c0766b653 Jul 21 18:31:34.235682 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.235647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60d46f8a-f9b9-448b-8082-3d4197de05a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5qjrv\" (UID: \"60d46f8a-f9b9-448b-8082-3d4197de05a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:34.235853 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:34.235828 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 21 18:31:34.235908 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:31:34.235900 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d46f8a-f9b9-448b-8082-3d4197de05a8-tls-certificates podName:60d46f8a-f9b9-448b-8082-3d4197de05a8 nodeName:}" failed. No retries permitted until 2026-07-21 18:31:34.735882033 +0000 UTC m=+80.669520414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/60d46f8a-f9b9-448b-8082-3d4197de05a8-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-5qjrv" (UID: "60d46f8a-f9b9-448b-8082-3d4197de05a8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 21 18:31:34.268704 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.268663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:34.399888 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.399784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:34.477962 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.477874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:34.593528 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.593434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:34.687341 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.687296 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:34.741321 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.741179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60d46f8a-f9b9-448b-8082-3d4197de05a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5qjrv\" (UID: \"60d46f8a-f9b9-448b-8082-3d4197de05a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:34.744293 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.744262 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/60d46f8a-f9b9-448b-8082-3d4197de05a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-5qjrv\" (UID: \"60d46f8a-f9b9-448b-8082-3d4197de05a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:34.875657 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:34.875623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:35.019998 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.019967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fqvg4" event={"ID":"de20c2bf-713c-4490-bad9-8b4e9a094b61","Type":"ContainerStarted","Data":"7ed57faa15ae38b0a0d1a0f9958a74432edd5613d3de3e820df4431c0766b653"} Jul 21 18:31:35.056024 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.055993 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv"] Jul 21 18:31:35.060744 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:35.060710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d46f8a_f9b9_448b_8082_3d4197de05a8.slice/crio-96cb655aff212c437e0ce05de3ce0e0cf042d438a4d869ce147877701c404577 WatchSource:0}: Error finding container 96cb655aff212c437e0ce05de3ce0e0cf042d438a4d869ce147877701c404577: Status 404 returned error can't find the container with id 96cb655aff212c437e0ce05de3ce0e0cf042d438a4d869ce147877701c404577 Jul 21 18:31:35.079958 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.079893 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:35.187944 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.187906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:35.287512 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.287409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:35.484064 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.484032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:35.739344 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.739125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:35.892328 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.892295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:35.986576 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:35.986543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:36.026000 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:36.025960 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" event={"ID":"60d46f8a-f9b9-448b-8082-3d4197de05a8","Type":"ContainerStarted","Data":"96cb655aff212c437e0ce05de3ce0e0cf042d438a4d869ce147877701c404577"} Jul 21 18:31:37.047941 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:37.047837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:37.121746 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:37.121683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:38.037752 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:38.037715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xvv2l" event={"ID":"853c902a-f290-432c-a097-4233d9340ad0","Type":"ContainerStarted","Data":"020bc56bc97a8e379f84df1b0c49c2f3bd42ab5e6ae3cf04ee7cf9bac6750606"} Jul 21 18:31:38.059192 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:38.059120 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xvv2l" podStartSLOduration=17.811751131 podStartE2EDuration="37.059072978s" totalImagesPullingTime="19.247321847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:31:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:38.056690737 +0000 UTC m=+83.990329135" watchObservedRunningTime="2026-07-21 18:31:38.059072978 +0000 UTC m=+83.992711376" Jul 21 18:31:39.043477 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:39.043436 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" event={"ID":"60d46f8a-f9b9-448b-8082-3d4197de05a8","Type":"ContainerStarted","Data":"fd91c814f34b02869614d9efaf9f4bd4bd23c660f0ff355b94ce1ac74f006a4c"} Jul 21 18:31:39.043853 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:39.043832 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:39.049017 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:39.048995 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" Jul 21 18:31:39.059273 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:39.059229 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-5qjrv" podStartSLOduration=2.990970937 podStartE2EDuration="6.059212499s" totalImagesPullingTime="3.068241562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:39.059053826 +0000 UTC m=+84.992692220" watchObservedRunningTime="2026-07-21 18:31:39.059212499 +0000 UTC m=+84.992850893" Jul 21 18:31:39.964237 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:39.964166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:40.035405 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:40.035365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:40.284922 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:40.284882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:40.345598 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:40.345549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:41.603152 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:41.603112 2565 patch_prober.go:28] interesting pod/image-registry-77b6775fc7-h8brm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 18:31:41.603587 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:41.603180 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 18:31:42.712942 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:42.712905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:42.777961 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:42.777922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:43.512403 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:43.512361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:43.600554 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:43.600512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:44.936762 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:44.936726 2565 patch_prober.go:28] interesting pod/image-registry-77b6775fc7-h8brm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 18:31:44.937185 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:44.936783 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 18:31:44.941360 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:44.941334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:45.029513 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:45.029480 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9hkz5" Jul 21 18:31:45.798954 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:45.798916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:45.863176 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:45.863139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.150387 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.150348 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.265538 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.265487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.418878 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.418780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.523567 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.522418 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4sqlr"] Jul 21 18:31:47.527428 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.527405 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.531337 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.531313 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nptl5\"" Jul 21 18:31:47.531484 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.531347 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 18:31:47.532328 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.532239 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 18:31:47.532328 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.532266 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 18:31:47.532555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.532246 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 18:31:47.541781 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.541756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.558001 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.557971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558213 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-textfile\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558213 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-tls\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558213 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558135 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8xps\" (UniqueName: \"kubernetes.io/projected/51cc8e44-238e-4d89-a4f0-46771a9bbca8-kube-api-access-c8xps\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558213 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-root\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558395 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-sys\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558395 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-wtmp\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558395 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558365 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.558503 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.558426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51cc8e44-238e-4d89-a4f0-46771a9bbca8-metrics-client-ca\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.656371 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.656337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.659246 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-sys\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659246 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-wtmp\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51cc8e44-238e-4d89-a4f0-46771a9bbca8-metrics-client-ca\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-sys\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-textfile\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659727 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659698 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-wtmp\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659782 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-tls\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659828 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8xps\" (UniqueName: \"kubernetes.io/projected/51cc8e44-238e-4d89-a4f0-46771a9bbca8-kube-api-access-c8xps\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659828 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-root\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659892 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659830 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-textfile\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.659921 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.659891 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51cc8e44-238e-4d89-a4f0-46771a9bbca8-root\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.660071 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.660043 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51cc8e44-238e-4d89-a4f0-46771a9bbca8-metrics-client-ca\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.660603 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.660510 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.662627 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.662602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.662821 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.662802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51cc8e44-238e-4d89-a4f0-46771a9bbca8-node-exporter-tls\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.670117 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.670004 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8xps\" (UniqueName: \"kubernetes.io/projected/51cc8e44-238e-4d89-a4f0-46771a9bbca8-kube-api-access-c8xps\") pod \"node-exporter-4sqlr\" (UID: \"51cc8e44-238e-4d89-a4f0-46771a9bbca8\") " pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.776785 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.776734 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:47.839646 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.839607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4sqlr" Jul 21 18:31:47.897440 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:47.897404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:48.046987 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:48.046952 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:48.157818 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:48.157782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:48.549784 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:48.549747 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:48.694374 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:48.694342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:48.804862 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:48.804770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:49.013459 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:49.013397 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:49.104578 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:49.104492 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:50.441680 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:50.441559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:50.542678 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:50.542589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:50.783624 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:50.783589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:50.989942 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:50.989892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:51.602059 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:51.602027 2565 patch_prober.go:28] interesting pod/image-registry-77b6775fc7-h8brm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 18:31:51.602529 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:51.602076 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 18:31:52.233748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:52.233709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:52.339378 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:52.339321 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:52.416029 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:52.415992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:52.632949 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:31:52.632916 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cc8e44_238e_4d89_a4f0_46771a9bbca8.slice/crio-38dd32afeeb42f30bdcfc87fb331961a88afac02ca935bdfc404e530c53ac0e2 WatchSource:0}: Error finding container 38dd32afeeb42f30bdcfc87fb331961a88afac02ca935bdfc404e530c53ac0e2: Status 404 returned error can't find the container with id 38dd32afeeb42f30bdcfc87fb331961a88afac02ca935bdfc404e530c53ac0e2 Jul 21 18:31:53.111891 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:53.111813 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sqlr" event={"ID":"51cc8e44-238e-4d89-a4f0-46771a9bbca8","Type":"ContainerStarted","Data":"38dd32afeeb42f30bdcfc87fb331961a88afac02ca935bdfc404e530c53ac0e2"} Jul 21 18:31:53.839137 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:53.839073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:54.118847 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.118803 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fqvg4" event={"ID":"de20c2bf-713c-4490-bad9-8b4e9a094b61","Type":"ContainerStarted","Data":"a584c445791d86506fe2aa5a5bd91ba4e0fe0288eba1446ada5e1aee36efc536"} Jul 21 18:31:54.120164 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.119870 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:54.121927 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.121896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sqlr" event={"ID":"51cc8e44-238e-4d89-a4f0-46771a9bbca8","Type":"ContainerStarted","Data":"5b23ad80e76d826b3d2c2081cf45449e8407bd6dd3daef2a37f5d4f750615d05"} Jul 21 18:31:54.137239 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.137208 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-fqvg4" Jul 21 18:31:54.162320 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.162266 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-fqvg4" podStartSLOduration=2.337581942 podStartE2EDuration="21.162243806s" totalImagesPullingTime="18.824661864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:54.16112111 +0000 UTC m=+100.094759507" watchObservedRunningTime="2026-07-21 18:31:54.162243806 +0000 UTC m=+100.095882199" Jul 21 18:31:54.405745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.405657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:54.510279 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.510241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:54.938822 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:54.938786 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:31:55.128729 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:55.128684 2565 generic.go:356] "Generic (PLEG): container finished" podID="51cc8e44-238e-4d89-a4f0-46771a9bbca8" containerID="5b23ad80e76d826b3d2c2081cf45449e8407bd6dd3daef2a37f5d4f750615d05" exitCode=0 Jul 21 18:31:55.128925 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:55.128779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sqlr" event={"ID":"51cc8e44-238e-4d89-a4f0-46771a9bbca8","Type":"ContainerDied","Data":"5b23ad80e76d826b3d2c2081cf45449e8407bd6dd3daef2a37f5d4f750615d05"} Jul 21 18:31:55.324244 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:55.324208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:55.430071 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:55.430032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:55.939498 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:55.939466 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2656j" Jul 21 18:31:56.136541 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:56.136498 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sqlr" event={"ID":"51cc8e44-238e-4d89-a4f0-46771a9bbca8","Type":"ContainerStarted","Data":"b92d03f03b27ad6ba8e570e7b6ab8fcf1c21958f15b40b67bfe12fc2e6f40de0"} Jul 21 18:31:56.136715 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:56.136569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4sqlr" event={"ID":"51cc8e44-238e-4d89-a4f0-46771a9bbca8","Type":"ContainerStarted","Data":"6f5ebd97ab70dc718cbbcc0bbebb887b250992a18113bfcd9f1e9c4c104e4821"} Jul 21 18:31:56.560921 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:56.560884 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:56.678254 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:56.678202 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:56.950294 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:56.950190 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:57.053812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:57.053773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:57.729015 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:57.728954 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4sqlr" podStartSLOduration=9.253715958 podStartE2EDuration="10.728927201s" totalImagesPullingTime="1.33095089s" totalInitContainerRuntime="144.260353ms" isStatefulPod=true podCreationTimestamp="2026-07-21 18:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:31:56.165716972 +0000 UTC m=+102.099355416" watchObservedRunningTime="2026-07-21 18:31:57.728927201 +0000 UTC m=+103.662565596" Jul 21 18:31:57.729714 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:57.729686 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b6775fc7-h8brm"] Jul 21 18:31:57.878438 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:57.878389 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:57.987420 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:57.987331 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:31:58.088170 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:31:58.088135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:01.539533 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:01.539488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:01.640627 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:01.640590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:02.308756 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:02.308722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:03.290076 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:03.290033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:03.405448 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:03.405407 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:04.340685 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:04.340652 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:04.442286 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:04.442257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:05.566041 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:05.566006 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:05.663732 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:05.663693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:13.806111 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:13.803403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:13.879687 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:13.879652 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:16.220626 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:16.220545 2565 generic.go:356] "Generic (PLEG): container finished" podID="2c110131-b834-4e7d-abb0-c044b1d1fa0f" containerID="c9d47ad0c05ffaae640b36fffcf89e5ac42f30a12d389faeaa63fd7d3b4bb2a6" exitCode=0 Jul 21 18:32:16.220626 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:16.220617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" event={"ID":"2c110131-b834-4e7d-abb0-c044b1d1fa0f","Type":"ContainerDied","Data":"c9d47ad0c05ffaae640b36fffcf89e5ac42f30a12d389faeaa63fd7d3b4bb2a6"} Jul 21 18:32:16.221011 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:16.220945 2565 scope.go:117] "RemoveContainer" containerID="c9d47ad0c05ffaae640b36fffcf89e5ac42f30a12d389faeaa63fd7d3b4bb2a6" Jul 21 18:32:17.226464 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:17.226428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-kxkj4" event={"ID":"2c110131-b834-4e7d-abb0-c044b1d1fa0f","Type":"ContainerStarted","Data":"fede8edb727913392e98c6e8a8d16c303b6224aef4e4ed78f44e766c46d1ec08"} Jul 21 18:32:18.859906 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:18.859849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:18.959170 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:18.959133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:22.756255 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:22.756207 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" containerID="cri-o://740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1" gracePeriod=30 Jul 21 18:32:23.055254 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.055221 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:32:23.077812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077181 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-installation-pull-secrets\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.077812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077245 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-image-registry-private-configuration\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.077812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077279 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-trusted-ca\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.077812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077344 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g4r2\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-kube-api-access-9g4r2\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.077812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077376 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/563dcd7d-5673-4890-b407-178d6f04ee11-ca-trust-extracted\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.077812 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077403 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-registry-certificates\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.078334 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.077959 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:32:23.078334 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.078153 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:32:23.080759 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.080728 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:32:23.080910 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.080814 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:32:23.080910 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.080834 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-kube-api-access-9g4r2" (OuterVolumeSpecName: "kube-api-access-9g4r2") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "kube-api-access-9g4r2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:32:23.088835 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.088785 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563dcd7d-5673-4890-b407-178d6f04ee11-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:32:23.178210 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178173 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.178210 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178211 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-bound-sa-token\") pod \"563dcd7d-5673-4890-b407-178d6f04ee11\" (UID: \"563dcd7d-5673-4890-b407-178d6f04ee11\") " Jul 21 18:32:23.178468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178370 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-installation-pull-secrets\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.178468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178382 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/563dcd7d-5673-4890-b407-178d6f04ee11-image-registry-private-configuration\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.178468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178392 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-trusted-ca\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.178468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178400 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g4r2\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-kube-api-access-9g4r2\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.178468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178408 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/563dcd7d-5673-4890-b407-178d6f04ee11-ca-trust-extracted\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.178468 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.178416 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/563dcd7d-5673-4890-b407-178d6f04ee11-registry-certificates\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.180428 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.180394 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:32:23.180515 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.180456 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "563dcd7d-5673-4890-b407-178d6f04ee11" (UID: "563dcd7d-5673-4890-b407-178d6f04ee11"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:32:23.253992 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.253958 2565 generic.go:356] "Generic (PLEG): container finished" podID="563dcd7d-5673-4890-b407-178d6f04ee11" containerID="740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1" exitCode=0 Jul 21 18:32:23.254167 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.254024 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" Jul 21 18:32:23.254167 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.254048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" event={"ID":"563dcd7d-5673-4890-b407-178d6f04ee11","Type":"ContainerDied","Data":"740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1"} Jul 21 18:32:23.254167 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.254163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b6775fc7-h8brm" event={"ID":"563dcd7d-5673-4890-b407-178d6f04ee11","Type":"ContainerDied","Data":"73e130a46f76c78847c79128f65000c01fa005df1de56b8c2e2b71c8b9b713d9"} Jul 21 18:32:23.254317 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.254192 2565 scope.go:117] "RemoveContainer" containerID="740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1" Jul 21 18:32:23.263361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.263320 2565 scope.go:117] "RemoveContainer" containerID="740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1" Jul 21 18:32:23.263601 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:32:23.263582 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1\": container with ID starting with 740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1 not found: ID does not exist" containerID="740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1" Jul 21 18:32:23.263672 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.263608 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1"} err="failed to get container status \"740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1\": rpc error: code = NotFound desc = could not find container \"740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1\": container with ID starting with 740f50133a50ce1fe37bffb78ae9592cebf7482a19ada8a9a24e994f154a61f1 not found: ID does not exist" Jul 21 18:32:23.278702 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.278677 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.278702 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.278700 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563dcd7d-5673-4890-b407-178d6f04ee11-bound-sa-token\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:32:23.284836 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.284810 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b6775fc7-h8brm"] Jul 21 18:32:23.289357 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:23.289334 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77b6775fc7-h8brm"] Jul 21 18:32:24.557651 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:24.557614 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" path="/var/lib/kubelet/pods/563dcd7d-5673-4890-b407-178d6f04ee11/volumes" Jul 21 18:32:26.268101 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:26.268065 2565 generic.go:356] "Generic (PLEG): container finished" podID="4527c326-62ce-4224-94e6-f4f8f85be296" containerID="bb54d96e621dd2bc55f3ea820715a3c2d8e6df63f4c45e6600998a95aa4ccc7b" exitCode=0 Jul 21 18:32:26.268464 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:26.268140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" event={"ID":"4527c326-62ce-4224-94e6-f4f8f85be296","Type":"ContainerDied","Data":"bb54d96e621dd2bc55f3ea820715a3c2d8e6df63f4c45e6600998a95aa4ccc7b"} Jul 21 18:32:26.268525 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:26.268508 2565 scope.go:117] "RemoveContainer" containerID="bb54d96e621dd2bc55f3ea820715a3c2d8e6df63f4c45e6600998a95aa4ccc7b" Jul 21 18:32:27.273928 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:27.273896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-6ttsz" event={"ID":"4527c326-62ce-4224-94e6-f4f8f85be296","Type":"ContainerStarted","Data":"2c99c38261cf046c91c3b30bc61abed35290ec63de22f66263324a9cd398c36f"} Jul 21 18:32:28.794738 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:28.794697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:28.856748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:28.856704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:31.290517 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:31.290486 2565 generic.go:356] "Generic (PLEG): container finished" podID="c3180351-57cd-4a37-a9e8-f9c4b01dde1b" containerID="7b3bbad7cb180293cb439a63452cb4b52f82107b607b1259c246217430888617" exitCode=0 Jul 21 18:32:31.290892 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:31.290527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xl85l" event={"ID":"c3180351-57cd-4a37-a9e8-f9c4b01dde1b","Type":"ContainerDied","Data":"7b3bbad7cb180293cb439a63452cb4b52f82107b607b1259c246217430888617"} Jul 21 18:32:31.290934 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:31.290894 2565 scope.go:117] "RemoveContainer" containerID="7b3bbad7cb180293cb439a63452cb4b52f82107b607b1259c246217430888617" Jul 21 18:32:32.163613 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:32.163579 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67c9769c8d-svp7r_92b73819-48f9-42a1-817a-813c899b1853/router/0.log" Jul 21 18:32:32.182738 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:32.182709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n54cs_2387f71e-ff4d-459c-a1f9-ca28a78e1800/serve-healthcheck-canary/0.log" Jul 21 18:32:32.239728 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:32.239691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:32.296744 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:32.296712 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xl85l" event={"ID":"c3180351-57cd-4a37-a9e8-f9c4b01dde1b","Type":"ContainerStarted","Data":"5d9e5dfc15e50531d027d7ce99f2ea65d44f73519205983f3e42df3be0874280"} Jul 21 18:32:36.150371 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:36.150334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:36.252534 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:36.252488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:32:36.330292 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:32:36.330256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:06.781755 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:06.781660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:06.880883 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:06.880849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:16.112454 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:16.112404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:16.213972 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:16.213937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:16.312837 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:16.312800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:16.852412 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:16.852368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:16.953390 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:16.953353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:27.256940 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:27.256909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:27.358641 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:27.358605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:33:27.413541 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:33:27.413505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:02.334301 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:02.334253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:02.435792 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:02.435757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:22.000269 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:22.000231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:22.056824 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:22.056787 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:30.187479 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:30.187431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:30.240028 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:30.239984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:33.940067 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:33.940029 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:33.997041 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:33.997011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:41.527765 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:41.527680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:42.992180 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:42.992147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:43.806829 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:43.806802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:43.908128 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:43.908070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:45.812061 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:45.812022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:34:45.908501 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:34:45.908461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:35:02.175582 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:02.175544 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:35:02.268451 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:02.268413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:35:02.339316 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:02.339280 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:35:14.416613 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:14.416583 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:35:14.421174 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:14.421150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:35:14.425651 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:14.425617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:35:14.428347 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:14.428324 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 18:35:14.429796 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:14.429777 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:35:14.462193 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:14.462156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:35:49.147928 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:49.147886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:35:49.284659 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:35:49.284619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:36:06.085497 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:06.085414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:36:06.621867 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:06.621835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:36:43.330078 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:43.330036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:36:43.433262 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:43.433233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:36:44.038670 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.038631 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:36:44.041782 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.041758 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr"] Jul 21 18:36:44.042063 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.042052 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" Jul 21 18:36:44.042115 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.042065 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" Jul 21 18:36:44.042156 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.042141 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="563dcd7d-5673-4890-b407-178d6f04ee11" containerName="registry" Jul 21 18:36:44.044901 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.044884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:36:44.047470 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.047445 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 21 18:36:44.048366 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.048346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-chkrw\"" Jul 21 18:36:44.048366 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.048354 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 21 18:36:44.060366 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.060334 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr"] Jul 21 18:36:44.107591 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.107559 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsghm\" (UniqueName: \"kubernetes.io/projected/65d8bb34-bbae-4d71-b6c7-4914e44a9e93-kube-api-access-xsghm\") pod \"feast-operator-controller-manager-7fc4b879bb-56gfr\" (UID: \"65d8bb34-bbae-4d71-b6c7-4914e44a9e93\") " pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:36:44.208850 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.208814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsghm\" (UniqueName: \"kubernetes.io/projected/65d8bb34-bbae-4d71-b6c7-4914e44a9e93-kube-api-access-xsghm\") pod \"feast-operator-controller-manager-7fc4b879bb-56gfr\" (UID: \"65d8bb34-bbae-4d71-b6c7-4914e44a9e93\") " pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:36:44.217719 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.217693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsghm\" (UniqueName: \"kubernetes.io/projected/65d8bb34-bbae-4d71-b6c7-4914e44a9e93-kube-api-access-xsghm\") pod \"feast-operator-controller-manager-7fc4b879bb-56gfr\" (UID: \"65d8bb34-bbae-4d71-b6c7-4914e44a9e93\") " pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:36:44.355562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.355468 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:36:44.491987 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.491961 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr"] Jul 21 18:36:44.494650 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:36:44.494608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d8bb34_bbae_4d71_b6c7_4914e44a9e93.slice/crio-883d05a1e4cd7990846aee721cef0f7f7850283be4e3c8a14e79ad0dac9700bc WatchSource:0}: Error finding container 883d05a1e4cd7990846aee721cef0f7f7850283be4e3c8a14e79ad0dac9700bc: Status 404 returned error can't find the container with id 883d05a1e4cd7990846aee721cef0f7f7850283be4e3c8a14e79ad0dac9700bc Jul 21 18:36:44.496713 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:44.496697 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:36:45.263107 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:45.263042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" event={"ID":"65d8bb34-bbae-4d71-b6c7-4914e44a9e93","Type":"ContainerStarted","Data":"883d05a1e4cd7990846aee721cef0f7f7850283be4e3c8a14e79ad0dac9700bc"} Jul 21 18:36:47.273349 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:47.273305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" event={"ID":"65d8bb34-bbae-4d71-b6c7-4914e44a9e93","Type":"ContainerStarted","Data":"205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2"} Jul 21 18:36:47.273754 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:47.273429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:36:47.290199 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:47.290148 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" podStartSLOduration=0.939521466 podStartE2EDuration="3.290132428s" totalImagesPullingTime="2.350610962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:36:47.288857713 +0000 UTC m=+393.222496107" watchObservedRunningTime="2026-07-21 18:36:47.290132428 +0000 UTC m=+393.223770821" Jul 21 18:36:58.280083 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:36:58.280050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:37:20.394443 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.394405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:20.495371 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.495334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:20.712562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.712473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:20.811612 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.811569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:20.817207 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.817179 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj"] Jul 21 18:37:20.821007 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.820989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.824348 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.824324 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 21 18:37:20.824483 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.824325 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-wsj4b\"" Jul 21 18:37:20.826232 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.826202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 21 18:37:20.826544 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.826525 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jul 21 18:37:20.826651 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.826566 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 21 18:37:20.826651 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.826593 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 21 18:37:20.826937 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.826881 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 21 18:37:20.827191 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.827169 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 21 18:37:20.836519 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.836490 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj"] Jul 21 18:37:20.888685 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.888645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:20.913051 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.913010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-ui-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.913225 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.913102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1545543-3a9a-496e-ad60-480fb3264ec3-feast-data\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.913225 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.913150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.913225 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.913175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.913225 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.913200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcsb\" (UniqueName: \"kubernetes.io/projected/f1545543-3a9a-496e-ad60-480fb3264ec3-kube-api-access-5tcsb\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.913381 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.913238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:20.958738 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:20.958695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:21.014150 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-ui-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.014356 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1545543-3a9a-496e-ad60-480fb3264ec3-feast-data\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.014356 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.014356 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014212 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.014356 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcsb\" (UniqueName: \"kubernetes.io/projected/f1545543-3a9a-496e-ad60-480fb3264ec3-kube-api-access-5tcsb\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.014356 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014267 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.014753 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.014712 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1545543-3a9a-496e-ad60-480fb3264ec3-feast-data\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.016871 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.016844 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.017081 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.017063 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.017389 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.017368 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-ui-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.017430 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.017412 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.024235 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.024199 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcsb\" (UniqueName: \"kubernetes.io/projected/f1545543-3a9a-496e-ad60-480fb3264ec3-kube-api-access-5tcsb\") pod \"feast-simple-feast-setup-8c76fccb-9rbwj\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.059660 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.059623 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:21.144347 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.144305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:37:21.292056 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.291955 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj"] Jul 21 18:37:21.296072 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:37:21.296044 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1545543_3a9a_496e_ad60_480fb3264ec3.slice/crio-26f88a6aca9f1e08a29bff325fc4ea6c68a0859a938d306e4edbcdb742ec1aec WatchSource:0}: Error finding container 26f88a6aca9f1e08a29bff325fc4ea6c68a0859a938d306e4edbcdb742ec1aec: Status 404 returned error can't find the container with id 26f88a6aca9f1e08a29bff325fc4ea6c68a0859a938d306e4edbcdb742ec1aec Jul 21 18:37:21.412218 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:21.412183 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"26f88a6aca9f1e08a29bff325fc4ea6c68a0859a938d306e4edbcdb742ec1aec"} Jul 21 18:37:33.481965 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:33.481929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:37:54.557713 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:54.557677 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489"} Jul 21 18:37:59.572404 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:59.572369 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerID="93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489" exitCode=0 Jul 21 18:37:59.572903 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:37:59.572447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489"} Jul 21 18:38:00.579166 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:00.579123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599"} Jul 21 18:38:05.601866 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:05.601825 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerID="0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599" exitCode=0 Jul 21 18:38:05.602402 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:05.601898 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599"} Jul 21 18:38:06.611750 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:06.611713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356"} Jul 21 18:38:06.612295 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:06.611777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae"} Jul 21 18:38:06.612295 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:06.611799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d"} Jul 21 18:38:06.612295 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:06.611822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerStarted","Data":"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3"} Jul 21 18:38:06.640766 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:06.640687 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podStartSLOduration=14.350209902 podStartE2EDuration="46.640660461s" totalImagesPullingTime="32.290450559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:37:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:38:06.637794779 +0000 UTC m=+472.571433173" watchObservedRunningTime="2026-07-21 18:38:06.640660461 +0000 UTC m=+472.574298857" Jul 21 18:38:09.144980 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.144936 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:09.145492 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.145010 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:09.145492 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.145029 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:09.145492 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.145045 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:09.147451 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.147394 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Jul 21 18:38:09.147610 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.147397 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Jul 21 18:38:09.147610 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.147399 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 21 18:38:09.147728 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:09.147704 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 21 18:38:11.144791 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:11.144743 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:11.145338 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:11.144819 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:11.145338 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:11.144840 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:11.145338 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:11.144910 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:12.144866 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.144819 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 21 18:38:12.145679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.145644 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:12.145908 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.145891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:12.150890 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.150863 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:12.644816 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.644789 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:12.645006 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.644903 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:12.647576 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:12.647553 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:15.145365 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:15.145333 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:15.656780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:15.656756 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:38:16.011353 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:16.011318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:21.357627 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:21.357594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:21.438050 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:21.438018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:31.995866 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:31.995830 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:32.118076 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:32.118040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:32.205312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:32.205267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:39.193511 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:39.193476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:39.273605 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:39.273571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:41.233034 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:41.232990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:38:41.329577 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:38:41.329547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.178843 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.178803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.184533 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.184504 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj"] Jul 21 18:39:18.184835 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.184804 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="registry" containerID="cri-o://180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3" gracePeriod=30 Jul 21 18:39:18.185052 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.184890 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="offline" containerID="cri-o://8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae" gracePeriod=30 Jul 21 18:39:18.185369 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.184869 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" containerID="cri-o://e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d" gracePeriod=30 Jul 21 18:39:18.185856 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.184918 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" containerID="cri-o://5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356" gracePeriod=30 Jul 21 18:39:18.278327 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.278300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.380145 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.380110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.452883 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.452797 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69"] Jul 21 18:39:18.457531 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.457487 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.460380 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.460349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.461852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.461821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bnmz5\"" Jul 21 18:39:18.476793 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.476758 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69"] Jul 21 18:39:18.521645 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.521610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.521859 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.521651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-ui-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.521859 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.521709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.521859 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.521771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.521859 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.521829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-feast-data\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.522255 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.521860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2854\" (UniqueName: \"kubernetes.io/projected/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-kube-api-access-n2854\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.522940 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.522908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.623291 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.623242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-feast-data\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.623291 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.623300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2854\" (UniqueName: \"kubernetes.io/projected/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-kube-api-access-n2854\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.623562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.623345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.623562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.623367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-ui-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.623562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.623408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.623562 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.623456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.623764 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:18.623583 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jul 21 18:39:18.623764 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:18.623642 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls podName:aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29 nodeName:}" failed. No retries permitted until 2026-07-21 18:39:19.123622021 +0000 UTC m=+545.057260400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls") pod "feast-simple-feast-setup-8c76fccb-jbg69" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29") : secret "feast-simple-feast-setup-registry-tls" not found Jul 21 18:39:18.623935 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:18.623918 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 21 18:39:18.623992 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:18.623969 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls podName:aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29 nodeName:}" failed. No retries permitted until 2026-07-21 18:39:19.12395519 +0000 UTC m=+545.057593575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls") pod "feast-simple-feast-setup-8c76fccb-jbg69" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29") : secret "feast-simple-feast-setup-online-tls" not found Jul 21 18:39:18.624047 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:18.624024 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 21 18:39:18.624119 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:18.624053 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls podName:aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29 nodeName:}" failed. No retries permitted until 2026-07-21 18:39:19.124044525 +0000 UTC m=+545.057682900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls") pod "feast-simple-feast-setup-8c76fccb-jbg69" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29") : secret "feast-simple-feast-setup-offline-tls" not found Jul 21 18:39:18.624447 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.624421 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-feast-data\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.627524 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.627494 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-ui-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.635231 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.635193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2854\" (UniqueName: \"kubernetes.io/projected/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-kube-api-access-n2854\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:18.807236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.807197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:18.912419 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.912388 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerID="5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356" exitCode=0 Jul 21 18:39:18.912606 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:18.912459 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356"} Jul 21 18:39:19.129280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.129139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:19.129280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.129229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:19.129537 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.129292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:19.129537 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:19.129398 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jul 21 18:39:19.129537 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:19.129471 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls podName:aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29 nodeName:}" failed. No retries permitted until 2026-07-21 18:39:20.129451341 +0000 UTC m=+546.063089726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls") pod "feast-simple-feast-setup-8c76fccb-jbg69" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29") : secret "feast-simple-feast-setup-online-tls" not found Jul 21 18:39:19.131760 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.131730 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:19.131868 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.131820 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:19.163861 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.163815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:19.220061 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.220018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:19.918720 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.918686 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerID="e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d" exitCode=0 Jul 21 18:39:19.918886 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:19.918753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d"} Jul 21 18:39:20.137474 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:20.137428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:20.140009 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:20.139978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") pod \"feast-simple-feast-setup-8c76fccb-jbg69\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:20.276893 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:20.276856 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:20.420257 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:20.420226 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69"] Jul 21 18:39:20.422050 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:39:20.422013 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad9d6ca_00dc_4ad7_a0f1_dc7d23323e29.slice/crio-056dcc02f53adcd1fa1abb1e2d9233ffb567484c7b6dc37e32413dbbf632a42b WatchSource:0}: Error finding container 056dcc02f53adcd1fa1abb1e2d9233ffb567484c7b6dc37e32413dbbf632a42b: Status 404 returned error can't find the container with id 056dcc02f53adcd1fa1abb1e2d9233ffb567484c7b6dc37e32413dbbf632a42b Jul 21 18:39:20.924122 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:20.924070 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"01836e1ee49b7fb5aab1dac1b3b64c2840e23b75bdcb22a0ce2bebae4ba8bcdd"} Jul 21 18:39:20.924326 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:20.924136 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"056dcc02f53adcd1fa1abb1e2d9233ffb567484c7b6dc37e32413dbbf632a42b"} Jul 21 18:39:22.645509 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:22.645461 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 21 18:39:25.657190 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:25.657079 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 21 18:39:25.945159 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:25.945052 2565 generic.go:356] "Generic (PLEG): container finished" podID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerID="01836e1ee49b7fb5aab1dac1b3b64c2840e23b75bdcb22a0ce2bebae4ba8bcdd" exitCode=0 Jul 21 18:39:25.945159 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:25.945108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"01836e1ee49b7fb5aab1dac1b3b64c2840e23b75bdcb22a0ce2bebae4ba8bcdd"} Jul 21 18:39:26.954105 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:26.954057 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"c5c9f9461db1d5273ac85682d1e5341b6814dcc62567f709db5227deebd587b6"} Jul 21 18:39:31.976108 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:31.976051 2565 generic.go:356] "Generic (PLEG): container finished" podID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerID="c5c9f9461db1d5273ac85682d1e5341b6814dcc62567f709db5227deebd587b6" exitCode=0 Jul 21 18:39:31.976494 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:31.976124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"c5c9f9461db1d5273ac85682d1e5341b6814dcc62567f709db5227deebd587b6"} Jul 21 18:39:32.646040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:32.645990 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 21 18:39:32.986247 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:32.986141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"a49c927acd8fe7fd5129b93dba2d5e3fc2ceb385f7c6944ddc5a6ba5e32d0b34"} Jul 21 18:39:32.986247 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:32.986208 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"3356e240274ac85c7634ca3b493aead216ffdef46824db19b4e58004973a023c"} Jul 21 18:39:32.986247 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:32.986229 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"ad5bfca61de41e3a38e571e572c048ba8d01fd62facaf4f20101e3686e345054"} Jul 21 18:39:32.986247 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:32.986246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerStarted","Data":"5e84a3a3eea9fdb33a0dddebec09c6d9cdb14f8b3e5c9d0054367ad714b9744c"} Jul 21 18:39:33.014170 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:33.014077 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podStartSLOduration=15.01405014 podStartE2EDuration="15.01405014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:39:33.012845857 +0000 UTC m=+558.946484254" watchObservedRunningTime="2026-07-21 18:39:33.01405014 +0000 UTC m=+558.947688535" Jul 21 18:39:35.277804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.277722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:35.277804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.277791 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:35.277804 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.277811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:35.278436 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.277827 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:35.280272 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.280235 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 21 18:39:35.280425 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.280280 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Jul 21 18:39:35.280425 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.280283 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 21 18:39:35.280425 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.280245 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Jul 21 18:39:35.657246 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:35.657142 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 21 18:39:38.277344 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.277296 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 21 18:39:38.278390 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.278365 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:38.278682 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.278663 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:38.279003 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.278982 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:38.279118 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.279020 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:38.279254 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.279227 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:38.279325 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.279292 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:38.283332 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:38.283313 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:39.021477 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:39.021455 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:39.024863 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:39.024839 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:40.277813 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:40.277782 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:41.278250 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:41.278224 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:42.034167 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:42.034143 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:39:42.460618 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:42.460514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:39:42.644924 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:42.644876 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 21 18:39:42.645152 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:42.645031 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:39:45.656543 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:45.656501 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 21 18:39:45.656932 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:45.656631 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:39:48.832708 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.832682 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:39:48.989159 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989051 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-online-tls\") pod \"f1545543-3a9a-496e-ad60-480fb3264ec3\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " Jul 21 18:39:48.989159 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989120 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-offline-tls\") pod \"f1545543-3a9a-496e-ad60-480fb3264ec3\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " Jul 21 18:39:48.989159 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989157 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-registry-tls\") pod \"f1545543-3a9a-496e-ad60-480fb3264ec3\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " Jul 21 18:39:48.989803 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989180 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tcsb\" (UniqueName: \"kubernetes.io/projected/f1545543-3a9a-496e-ad60-480fb3264ec3-kube-api-access-5tcsb\") pod \"f1545543-3a9a-496e-ad60-480fb3264ec3\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " Jul 21 18:39:48.989803 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989198 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-ui-tls\") pod \"f1545543-3a9a-496e-ad60-480fb3264ec3\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " Jul 21 18:39:48.989803 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989220 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1545543-3a9a-496e-ad60-480fb3264ec3-feast-data\") pod \"f1545543-3a9a-496e-ad60-480fb3264ec3\" (UID: \"f1545543-3a9a-496e-ad60-480fb3264ec3\") " Jul 21 18:39:48.990157 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.989929 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1545543-3a9a-496e-ad60-480fb3264ec3-feast-data" (OuterVolumeSpecName: "feast-data") pod "f1545543-3a9a-496e-ad60-480fb3264ec3" (UID: "f1545543-3a9a-496e-ad60-480fb3264ec3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:39:48.991728 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.991696 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f1545543-3a9a-496e-ad60-480fb3264ec3" (UID: "f1545543-3a9a-496e-ad60-480fb3264ec3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:39:48.991828 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.991781 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1545543-3a9a-496e-ad60-480fb3264ec3-kube-api-access-5tcsb" (OuterVolumeSpecName: "kube-api-access-5tcsb") pod "f1545543-3a9a-496e-ad60-480fb3264ec3" (UID: "f1545543-3a9a-496e-ad60-480fb3264ec3"). InnerVolumeSpecName "kube-api-access-5tcsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:39:48.991828 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.991783 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1545543-3a9a-496e-ad60-480fb3264ec3" (UID: "f1545543-3a9a-496e-ad60-480fb3264ec3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:39:48.991923 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.991905 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-online-tls" (OuterVolumeSpecName: "online-tls") pod "f1545543-3a9a-496e-ad60-480fb3264ec3" (UID: "f1545543-3a9a-496e-ad60-480fb3264ec3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:39:48.991989 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:48.991970 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f1545543-3a9a-496e-ad60-480fb3264ec3" (UID: "f1545543-3a9a-496e-ad60-480fb3264ec3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:39:49.063469 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063437 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerID="8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae" exitCode=137 Jul 21 18:39:49.063469 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063462 2565 generic.go:356] "Generic (PLEG): container finished" podID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerID="180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3" exitCode=137 Jul 21 18:39:49.063697 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae"} Jul 21 18:39:49.063697 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063509 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" Jul 21 18:39:49.063697 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3"} Jul 21 18:39:49.063697 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj" event={"ID":"f1545543-3a9a-496e-ad60-480fb3264ec3","Type":"ContainerDied","Data":"26f88a6aca9f1e08a29bff325fc4ea6c68a0859a938d306e4edbcdb742ec1aec"} Jul 21 18:39:49.063697 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.063569 2565 scope.go:117] "RemoveContainer" containerID="5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356" Jul 21 18:39:49.073011 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.072993 2565 scope.go:117] "RemoveContainer" containerID="8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae" Jul 21 18:39:49.080887 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.080868 2565 scope.go:117] "RemoveContainer" containerID="e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d" Jul 21 18:39:49.087106 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.087051 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj"] Jul 21 18:39:49.089316 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089295 2565 scope.go:117] "RemoveContainer" containerID="180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3" Jul 21 18:39:49.089790 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089773 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:39:49.089857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089795 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tcsb\" (UniqueName: \"kubernetes.io/projected/f1545543-3a9a-496e-ad60-480fb3264ec3-kube-api-access-5tcsb\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:39:49.089857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089807 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-ui-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:39:49.089857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089816 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1545543-3a9a-496e-ad60-480fb3264ec3-feast-data\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:39:49.089857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089825 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-online-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:39:49.089857 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.089832 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1545543-3a9a-496e-ad60-480fb3264ec3-offline-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:39:49.092936 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.092913 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-9rbwj"] Jul 21 18:39:49.097620 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.097603 2565 scope.go:117] "RemoveContainer" containerID="0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599" Jul 21 18:39:49.105499 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.105482 2565 scope.go:117] "RemoveContainer" containerID="93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489" Jul 21 18:39:49.113067 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113050 2565 scope.go:117] "RemoveContainer" containerID="5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356" Jul 21 18:39:49.113387 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:49.113365 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356\": container with ID starting with 5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356 not found: ID does not exist" containerID="5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356" Jul 21 18:39:49.113454 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113402 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356"} err="failed to get container status \"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356\": rpc error: code = NotFound desc = could not find container \"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356\": container with ID starting with 5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356 not found: ID does not exist" Jul 21 18:39:49.113454 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113427 2565 scope.go:117] "RemoveContainer" containerID="8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae" Jul 21 18:39:49.113703 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:49.113686 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae\": container with ID starting with 8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae not found: ID does not exist" containerID="8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae" Jul 21 18:39:49.113739 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113710 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae"} err="failed to get container status \"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae\": rpc error: code = NotFound desc = could not find container \"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae\": container with ID starting with 8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae not found: ID does not exist" Jul 21 18:39:49.113739 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113725 2565 scope.go:117] "RemoveContainer" containerID="e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d" Jul 21 18:39:49.113935 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:49.113920 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d\": container with ID starting with e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d not found: ID does not exist" containerID="e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d" Jul 21 18:39:49.113978 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113937 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d"} err="failed to get container status \"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d\": rpc error: code = NotFound desc = could not find container \"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d\": container with ID starting with e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d not found: ID does not exist" Jul 21 18:39:49.113978 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.113949 2565 scope.go:117] "RemoveContainer" containerID="180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3" Jul 21 18:39:49.114172 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:49.114156 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3\": container with ID starting with 180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3 not found: ID does not exist" containerID="180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3" Jul 21 18:39:49.114242 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114182 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3"} err="failed to get container status \"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3\": rpc error: code = NotFound desc = could not find container \"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3\": container with ID starting with 180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3 not found: ID does not exist" Jul 21 18:39:49.114242 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114202 2565 scope.go:117] "RemoveContainer" containerID="0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599" Jul 21 18:39:49.114425 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:49.114410 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599\": container with ID starting with 0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599 not found: ID does not exist" containerID="0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599" Jul 21 18:39:49.114465 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114429 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599"} err="failed to get container status \"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599\": rpc error: code = NotFound desc = could not find container \"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599\": container with ID starting with 0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599 not found: ID does not exist" Jul 21 18:39:49.114465 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114444 2565 scope.go:117] "RemoveContainer" containerID="93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489" Jul 21 18:39:49.114613 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:39:49.114598 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489\": container with ID starting with 93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489 not found: ID does not exist" containerID="93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489" Jul 21 18:39:49.114653 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114617 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489"} err="failed to get container status \"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489\": rpc error: code = NotFound desc = could not find container \"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489\": container with ID starting with 93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489 not found: ID does not exist" Jul 21 18:39:49.114653 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114630 2565 scope.go:117] "RemoveContainer" containerID="5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356" Jul 21 18:39:49.114800 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114785 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356"} err="failed to get container status \"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356\": rpc error: code = NotFound desc = could not find container \"5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356\": container with ID starting with 5f0d672af48f19a6063b9ce833762354afba415438baea3c30d19ed438ba5356 not found: ID does not exist" Jul 21 18:39:49.114841 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114800 2565 scope.go:117] "RemoveContainer" containerID="8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae" Jul 21 18:39:49.114966 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114951 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae"} err="failed to get container status \"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae\": rpc error: code = NotFound desc = could not find container \"8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae\": container with ID starting with 8b3c82740d7ba8d257eef453a26aeae2607b3180258d75ce8d7b00fcb8b46cae not found: ID does not exist" Jul 21 18:39:49.115007 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.114966 2565 scope.go:117] "RemoveContainer" containerID="e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d" Jul 21 18:39:49.115164 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115141 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d"} err="failed to get container status \"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d\": rpc error: code = NotFound desc = could not find container \"e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d\": container with ID starting with e58d55a403e5108257a783985da27e5da161840a1acac0319780b57db069e80d not found: ID does not exist" Jul 21 18:39:49.115164 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115163 2565 scope.go:117] "RemoveContainer" containerID="180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3" Jul 21 18:39:49.115379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115363 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3"} err="failed to get container status \"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3\": rpc error: code = NotFound desc = could not find container \"180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3\": container with ID starting with 180a457161aad6b6be8edb6017ae4c28e527b6c804f993ae35636f4e6b67bea3 not found: ID does not exist" Jul 21 18:39:49.115379 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115379 2565 scope.go:117] "RemoveContainer" containerID="0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599" Jul 21 18:39:49.115612 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115594 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599"} err="failed to get container status \"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599\": rpc error: code = NotFound desc = could not find container \"0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599\": container with ID starting with 0c53f0f0ef27f98724bcdfdf0b87a45b40aaa6cb9401f1a60075893ec1273599 not found: ID does not exist" Jul 21 18:39:49.115657 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115612 2565 scope.go:117] "RemoveContainer" containerID="93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489" Jul 21 18:39:49.115852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:49.115836 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489"} err="failed to get container status \"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489\": rpc error: code = NotFound desc = could not find container \"93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489\": container with ID starting with 93d448d726229d1055518cc96f5d534242622ba4b98d68b9cd3a7ac2e3e28489 not found: ID does not exist" Jul 21 18:39:50.557921 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:50.557883 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" path="/var/lib/kubelet/pods/f1545543-3a9a-496e-ad60-480fb3264ec3/volumes" Jul 21 18:39:54.519320 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:39:54.519290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:14.452242 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:14.452217 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:40:14.453861 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:14.453836 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:40:14.456342 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:14.456323 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:40:14.457806 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:14.457790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:40:43.874906 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:43.874829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:43.973326 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:43.973272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:44.072147 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.072108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:44.134132 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134032 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v"] Jul 21 18:40:44.134480 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134465 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="feast-apply" Jul 21 18:40:44.134547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134484 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="feast-apply" Jul 21 18:40:44.134547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134503 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="feast-init" Jul 21 18:40:44.134547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134511 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="feast-init" Jul 21 18:40:44.134547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134529 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="registry" Jul 21 18:40:44.134547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134537 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="registry" Jul 21 18:40:44.134547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134545 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="offline" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134552 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="offline" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134564 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134572 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134581 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134588 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134670 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="online" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134683 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="ui" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134694 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="registry" Jul 21 18:40:44.134745 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.134705 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1545543-3a9a-496e-ad60-480fb3264ec3" containerName="offline" Jul 21 18:40:44.138478 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.138461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141210 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141274 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-qqwn8\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141340 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141225 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141444 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141493 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 21 18:40:44.141642 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.141507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Jul 21 18:40:44.150341 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.150316 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v"] Jul 21 18:40:44.173268 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.173239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:44.234505 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.234467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.234676 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.234515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb20cc97-7e86-4435-b39e-693e906621c8-feast-data\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.234676 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.234551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s2r9\" (UniqueName: \"kubernetes.io/projected/bb20cc97-7e86-4435-b39e-693e906621c8-kube-api-access-8s2r9\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.234676 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.234601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.234676 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.234636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bb20cc97-7e86-4435-b39e-693e906621c8-registry-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.234676 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.234674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.335764 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.335704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.335764 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.335768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb20cc97-7e86-4435-b39e-693e906621c8-feast-data\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.336045 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.335813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s2r9\" (UniqueName: \"kubernetes.io/projected/bb20cc97-7e86-4435-b39e-693e906621c8-kube-api-access-8s2r9\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.336045 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.335852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.336045 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.335887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bb20cc97-7e86-4435-b39e-693e906621c8-registry-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.336045 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.335928 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.336297 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:40:44.335887 2565 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 21 18:40:44.336297 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:40:44.336152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls podName:bb20cc97-7e86-4435-b39e-693e906621c8 nodeName:}" failed. No retries permitted until 2026-07-21 18:40:44.836130874 +0000 UTC m=+630.769769252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls") pod "feast-simple-feast-remote-setup-5848dcfbc-v6t4v" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8") : secret "feast-simple-feast-remote-setup-offline-tls" not found Jul 21 18:40:44.336297 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.336209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb20cc97-7e86-4435-b39e-693e906621c8-feast-data\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.336297 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:40:44.335943 2565 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Jul 21 18:40:44.336502 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:40:44.336310 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls podName:bb20cc97-7e86-4435-b39e-693e906621c8 nodeName:}" failed. No retries permitted until 2026-07-21 18:40:44.836297979 +0000 UTC m=+630.769936350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls") pod "feast-simple-feast-remote-setup-5848dcfbc-v6t4v" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8") : secret "feast-simple-feast-remote-setup-online-tls" not found Jul 21 18:40:44.336502 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:40:44.336061 2565 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 21 18:40:44.336502 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:40:44.336338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls podName:bb20cc97-7e86-4435-b39e-693e906621c8 nodeName:}" failed. No retries permitted until 2026-07-21 18:40:44.836332685 +0000 UTC m=+630.769971057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls") pod "feast-simple-feast-remote-setup-5848dcfbc-v6t4v" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8") : secret "feast-simple-feast-remote-setup-ui-tls" not found Jul 21 18:40:44.336667 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.336607 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bb20cc97-7e86-4435-b39e-693e906621c8-registry-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.344915 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.344893 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s2r9\" (UniqueName: \"kubernetes.io/projected/bb20cc97-7e86-4435-b39e-693e906621c8-kube-api-access-8s2r9\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.397019 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.396930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:44.497105 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.497065 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:44.598354 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.598310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:40:44.840142 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.840072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.840336 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.840177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.840336 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.840217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.842777 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.842750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.842919 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.842808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:44.842919 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:44.842834 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls\") pod \"feast-simple-feast-remote-setup-5848dcfbc-v6t4v\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:45.051041 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:45.051000 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:40:45.196985 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:45.196959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v"] Jul 21 18:40:45.198553 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:40:45.198522 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb20cc97_7e86_4435_b39e_693e906621c8.slice/crio-198c228b2ed892f49ecb1dc4dbbae5f7439774a90da9f84445a26bc1b7244037 WatchSource:0}: Error finding container 198c228b2ed892f49ecb1dc4dbbae5f7439774a90da9f84445a26bc1b7244037: Status 404 returned error can't find the container with id 198c228b2ed892f49ecb1dc4dbbae5f7439774a90da9f84445a26bc1b7244037 Jul 21 18:40:45.285547 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:45.285511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerStarted","Data":"eb58089b1546e1032ff0b331bbe1f22dfbb403d97445e4e2ccc0369952b0a7ad"} Jul 21 18:40:45.285749 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:45.285564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerStarted","Data":"198c228b2ed892f49ecb1dc4dbbae5f7439774a90da9f84445a26bc1b7244037"} Jul 21 18:40:50.306217 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:50.306185 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb20cc97-7e86-4435-b39e-693e906621c8" containerID="eb58089b1546e1032ff0b331bbe1f22dfbb403d97445e4e2ccc0369952b0a7ad" exitCode=0 Jul 21 18:40:50.306712 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:50.306260 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerDied","Data":"eb58089b1546e1032ff0b331bbe1f22dfbb403d97445e4e2ccc0369952b0a7ad"} Jul 21 18:40:51.312584 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:51.312548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerStarted","Data":"5eb231931c369e8ca7d24f88a7fa77b235364d8c4919117aed41d05d47d0df90"} Jul 21 18:40:57.341631 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:57.341597 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb20cc97-7e86-4435-b39e-693e906621c8" containerID="5eb231931c369e8ca7d24f88a7fa77b235364d8c4919117aed41d05d47d0df90" exitCode=0 Jul 21 18:40:57.342049 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:57.341671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerDied","Data":"5eb231931c369e8ca7d24f88a7fa77b235364d8c4919117aed41d05d47d0df90"} Jul 21 18:40:58.350288 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:58.350235 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerStarted","Data":"6deaa9627245fc28ff98e3b02fe8e7c7c0f7661015269af689343709bbd0fbf2"} Jul 21 18:40:58.350779 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:58.350313 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerStarted","Data":"d062a0adb779d02467acf249906b6c8bff187ee0a131c1c5533fdaa94daa507b"} Jul 21 18:40:58.350779 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:58.350335 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerStarted","Data":"a9677820c1decc528e0a015d6bf963a036d31397d4641a2db4430f38668b5eb4"} Jul 21 18:40:58.376465 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:40:58.376408 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podStartSLOduration=14.376388339 podStartE2EDuration="14.376388339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:40:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:40:58.374721317 +0000 UTC m=+644.308359728" watchObservedRunningTime="2026-07-21 18:40:58.376388339 +0000 UTC m=+644.310026733" Jul 21 18:41:00.051817 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:00.051784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:00.052424 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:00.052388 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:00.052424 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:00.052417 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:00.053723 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:00.053690 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 21 18:41:00.053723 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:00.053711 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Jul 21 18:41:00.053894 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:00.053737 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 21 18:41:03.051679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:03.051636 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 21 18:41:03.052188 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:03.051639 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 21 18:41:03.052374 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:03.052353 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:03.052861 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:03.052837 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:03.053246 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:03.053227 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:05.052067 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:05.052025 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:05.052532 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:05.052105 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:06.051899 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:06.051871 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:06.058833 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:06.058803 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:06.402484 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:06.402396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:06.406460 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:06.406429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:41:06.646209 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:41:06.646174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:07.435780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.435681 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:07.493048 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.493010 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v"] Jul 21 18:42:07.493354 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.493323 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" containerID="cri-o://a9677820c1decc528e0a015d6bf963a036d31397d4641a2db4430f38668b5eb4" gracePeriod=30 Jul 21 18:42:07.493605 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.493395 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="offline" containerID="cri-o://d062a0adb779d02467acf249906b6c8bff187ee0a131c1c5533fdaa94daa507b" gracePeriod=30 Jul 21 18:42:07.493732 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.493445 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" containerID="cri-o://6deaa9627245fc28ff98e3b02fe8e7c7c0f7661015269af689343709bbd0fbf2" gracePeriod=30 Jul 21 18:42:07.533165 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.533116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:07.636156 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.636122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:07.649821 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.649782 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69"] Jul 21 18:42:07.650303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.650068 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="registry" containerID="cri-o://5e84a3a3eea9fdb33a0dddebec09c6d9cdb14f8b3e5c9d0054367ad714b9744c" gracePeriod=30 Jul 21 18:42:07.650303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.650141 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" containerID="cri-o://ad5bfca61de41e3a38e571e572c048ba8d01fd62facaf4f20101e3686e345054" gracePeriod=30 Jul 21 18:42:07.650303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.650158 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" containerID="cri-o://a49c927acd8fe7fd5129b93dba2d5e3fc2ceb385f7c6944ddc5a6ba5e32d0b34" gracePeriod=30 Jul 21 18:42:07.650303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.650187 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="offline" containerID="cri-o://3356e240274ac85c7634ca3b493aead216ffdef46824db19b4e58004973a023c" gracePeriod=30 Jul 21 18:42:07.771240 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:07.771205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:08.656022 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.655945 2565 generic.go:356] "Generic (PLEG): container finished" podID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerID="a49c927acd8fe7fd5129b93dba2d5e3fc2ceb385f7c6944ddc5a6ba5e32d0b34" exitCode=0 Jul 21 18:42:08.656022 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.655970 2565 generic.go:356] "Generic (PLEG): container finished" podID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerID="ad5bfca61de41e3a38e571e572c048ba8d01fd62facaf4f20101e3686e345054" exitCode=0 Jul 21 18:42:08.656499 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.656017 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"a49c927acd8fe7fd5129b93dba2d5e3fc2ceb385f7c6944ddc5a6ba5e32d0b34"} Jul 21 18:42:08.656499 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.656066 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"ad5bfca61de41e3a38e571e572c048ba8d01fd62facaf4f20101e3686e345054"} Jul 21 18:42:08.658520 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.658499 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb20cc97-7e86-4435-b39e-693e906621c8" containerID="6deaa9627245fc28ff98e3b02fe8e7c7c0f7661015269af689343709bbd0fbf2" exitCode=0 Jul 21 18:42:08.658520 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.658516 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb20cc97-7e86-4435-b39e-693e906621c8" containerID="a9677820c1decc528e0a015d6bf963a036d31397d4641a2db4430f38668b5eb4" exitCode=0 Jul 21 18:42:08.658687 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.658571 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerDied","Data":"6deaa9627245fc28ff98e3b02fe8e7c7c0f7661015269af689343709bbd0fbf2"} Jul 21 18:42:08.658687 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:08.658615 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerDied","Data":"a9677820c1decc528e0a015d6bf963a036d31397d4641a2db4430f38668b5eb4"} Jul 21 18:42:09.022068 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:09.022030 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 21 18:42:12.034540 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:12.034500 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 21 18:42:12.870717 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:12.870673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:16.402611 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:16.402564 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 21 18:42:16.403034 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:16.402586 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 21 18:42:19.022665 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:19.022622 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 21 18:42:22.034203 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:22.034150 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 21 18:42:26.402613 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:26.402568 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 21 18:42:26.403041 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:26.402579 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 21 18:42:29.022560 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:29.022522 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Jul 21 18:42:29.022958 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:29.022652 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:42:32.034168 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:32.034118 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Jul 21 18:42:32.034610 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:32.034259 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:42:36.402183 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:36.402142 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Jul 21 18:42:36.402632 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:36.402153 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Jul 21 18:42:36.402632 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:36.402277 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:42:36.402632 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:36.402335 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:42:37.780518 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:37.780487 2565 generic.go:356] "Generic (PLEG): container finished" podID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerID="3356e240274ac85c7634ca3b493aead216ffdef46824db19b4e58004973a023c" exitCode=137 Jul 21 18:42:37.780518 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:37.780513 2565 generic.go:356] "Generic (PLEG): container finished" podID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerID="5e84a3a3eea9fdb33a0dddebec09c6d9cdb14f8b3e5c9d0054367ad714b9744c" exitCode=137 Jul 21 18:42:37.780927 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:37.780556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"3356e240274ac85c7634ca3b493aead216ffdef46824db19b4e58004973a023c"} Jul 21 18:42:37.780927 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:37.780601 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"5e84a3a3eea9fdb33a0dddebec09c6d9cdb14f8b3e5c9d0054367ad714b9744c"} Jul 21 18:42:37.783187 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:37.783161 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb20cc97-7e86-4435-b39e-693e906621c8" containerID="d062a0adb779d02467acf249906b6c8bff187ee0a131c1c5533fdaa94daa507b" exitCode=137 Jul 21 18:42:37.783312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:37.783209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerDied","Data":"d062a0adb779d02467acf249906b6c8bff187ee0a131c1c5533fdaa94daa507b"} Jul 21 18:42:38.146648 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.146622 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:42:38.308540 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.308514 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:42:38.309395 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309378 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls\") pod \"bb20cc97-7e86-4435-b39e-693e906621c8\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " Jul 21 18:42:38.309482 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309415 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s2r9\" (UniqueName: \"kubernetes.io/projected/bb20cc97-7e86-4435-b39e-693e906621c8-kube-api-access-8s2r9\") pod \"bb20cc97-7e86-4435-b39e-693e906621c8\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " Jul 21 18:42:38.309482 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309456 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls\") pod \"bb20cc97-7e86-4435-b39e-693e906621c8\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " Jul 21 18:42:38.309561 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309504 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls\") pod \"bb20cc97-7e86-4435-b39e-693e906621c8\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " Jul 21 18:42:38.309561 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bb20cc97-7e86-4435-b39e-693e906621c8-registry-tls\") pod \"bb20cc97-7e86-4435-b39e-693e906621c8\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " Jul 21 18:42:38.309651 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309589 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb20cc97-7e86-4435-b39e-693e906621c8-feast-data\") pod \"bb20cc97-7e86-4435-b39e-693e906621c8\" (UID: \"bb20cc97-7e86-4435-b39e-693e906621c8\") " Jul 21 18:42:38.310020 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.309986 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb20cc97-7e86-4435-b39e-693e906621c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bb20cc97-7e86-4435-b39e-693e906621c8" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 18:42:38.310256 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.310234 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb20cc97-7e86-4435-b39e-693e906621c8-feast-data" (OuterVolumeSpecName: "feast-data") pod "bb20cc97-7e86-4435-b39e-693e906621c8" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:42:38.311723 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.311700 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "bb20cc97-7e86-4435-b39e-693e906621c8" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.311808 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.311725 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bb20cc97-7e86-4435-b39e-693e906621c8" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.311808 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.311765 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb20cc97-7e86-4435-b39e-693e906621c8-kube-api-access-8s2r9" (OuterVolumeSpecName: "kube-api-access-8s2r9") pod "bb20cc97-7e86-4435-b39e-693e906621c8" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8"). InnerVolumeSpecName "kube-api-access-8s2r9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:42:38.312555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.312509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls" (OuterVolumeSpecName: "online-tls") pod "bb20cc97-7e86-4435-b39e-693e906621c8" (UID: "bb20cc97-7e86-4435-b39e-693e906621c8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.410523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410476 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2854\" (UniqueName: \"kubernetes.io/projected/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-kube-api-access-n2854\") pod \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " Jul 21 18:42:38.410523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410522 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-ui-tls\") pod \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " Jul 21 18:42:38.410777 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410579 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls\") pod \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " Jul 21 18:42:38.410777 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410609 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls\") pod \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " Jul 21 18:42:38.410777 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410645 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") pod \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " Jul 21 18:42:38.410777 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410705 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-feast-data\") pod \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\" (UID: \"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29\") " Jul 21 18:42:38.410975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410895 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-online-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.410975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410911 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/bb20cc97-7e86-4435-b39e-693e906621c8-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.410975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410925 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb20cc97-7e86-4435-b39e-693e906621c8-feast-data\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.410975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410937 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-ui-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.410975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410951 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s2r9\" (UniqueName: \"kubernetes.io/projected/bb20cc97-7e86-4435-b39e-693e906621c8-kube-api-access-8s2r9\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.410975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.410964 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb20cc97-7e86-4435-b39e-693e906621c8-offline-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.411531 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.411497 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-feast-data" (OuterVolumeSpecName: "feast-data") pod "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:42:38.413026 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.412998 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.413157 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.413026 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls" (OuterVolumeSpecName: "online-tls") pod "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.413157 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.413038 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.413317 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.413302 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:42:38.413375 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.413321 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-kube-api-access-n2854" (OuterVolumeSpecName: "kube-api-access-n2854") pod "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" (UID: "aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29"). InnerVolumeSpecName "kube-api-access-n2854". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:42:38.511524 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.511498 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.511524 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.511525 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-offline-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.511682 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.511537 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-online-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.511682 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.511544 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-feast-data\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.511682 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.511553 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2854\" (UniqueName: \"kubernetes.io/projected/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-kube-api-access-n2854\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.511682 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.511562 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29-ui-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:42:38.793669 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.793632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" event={"ID":"aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29","Type":"ContainerDied","Data":"056dcc02f53adcd1fa1abb1e2d9233ffb567484c7b6dc37e32413dbbf632a42b"} Jul 21 18:42:38.793669 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.793670 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" Jul 21 18:42:38.794287 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.793704 2565 scope.go:117] "RemoveContainer" containerID="a49c927acd8fe7fd5129b93dba2d5e3fc2ceb385f7c6944ddc5a6ba5e32d0b34" Jul 21 18:42:38.796723 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.796694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" event={"ID":"bb20cc97-7e86-4435-b39e-693e906621c8","Type":"ContainerDied","Data":"198c228b2ed892f49ecb1dc4dbbae5f7439774a90da9f84445a26bc1b7244037"} Jul 21 18:42:38.796952 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.796932 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v" Jul 21 18:42:38.803633 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.803611 2565 scope.go:117] "RemoveContainer" containerID="3356e240274ac85c7634ca3b493aead216ffdef46824db19b4e58004973a023c" Jul 21 18:42:38.811863 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.811839 2565 scope.go:117] "RemoveContainer" containerID="ad5bfca61de41e3a38e571e572c048ba8d01fd62facaf4f20101e3686e345054" Jul 21 18:42:38.815261 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.815233 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v"] Jul 21 18:42:38.820705 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.820683 2565 scope.go:117] "RemoveContainer" containerID="5e84a3a3eea9fdb33a0dddebec09c6d9cdb14f8b3e5c9d0054367ad714b9744c" Jul 21 18:42:38.821336 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.821316 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5848dcfbc-v6t4v"] Jul 21 18:42:38.829225 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.829204 2565 scope.go:117] "RemoveContainer" containerID="c5c9f9461db1d5273ac85682d1e5341b6814dcc62567f709db5227deebd587b6" Jul 21 18:42:38.835313 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.835288 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69"] Jul 21 18:42:38.837690 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.837673 2565 scope.go:117] "RemoveContainer" containerID="01836e1ee49b7fb5aab1dac1b3b64c2840e23b75bdcb22a0ce2bebae4ba8bcdd" Jul 21 18:42:38.840529 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.840510 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69"] Jul 21 18:42:38.845937 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.845920 2565 scope.go:117] "RemoveContainer" containerID="6deaa9627245fc28ff98e3b02fe8e7c7c0f7661015269af689343709bbd0fbf2" Jul 21 18:42:38.853977 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.853956 2565 scope.go:117] "RemoveContainer" containerID="d062a0adb779d02467acf249906b6c8bff187ee0a131c1c5533fdaa94daa507b" Jul 21 18:42:38.861751 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.861727 2565 scope.go:117] "RemoveContainer" containerID="a9677820c1decc528e0a015d6bf963a036d31397d4641a2db4430f38668b5eb4" Jul 21 18:42:38.869488 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.869469 2565 scope.go:117] "RemoveContainer" containerID="5eb231931c369e8ca7d24f88a7fa77b235364d8c4919117aed41d05d47d0df90" Jul 21 18:42:38.876852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:38.876830 2565 scope.go:117] "RemoveContainer" containerID="eb58089b1546e1032ff0b331bbe1f22dfbb403d97445e4e2ccc0369952b0a7ad" Jul 21 18:42:39.279864 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:39.279823 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: i/o timeout" Jul 21 18:42:39.280042 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:39.279823 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-8c76fccb-jbg69" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: i/o timeout" Jul 21 18:42:40.556453 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:40.556419 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" path="/var/lib/kubelet/pods/aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29/volumes" Jul 21 18:42:40.557006 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:40.556992 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" path="/var/lib/kubelet/pods/bb20cc97-7e86-4435-b39e-693e906621c8/volumes" Jul 21 18:42:50.667014 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:50.666979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:51.038948 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.038914 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-7fl97"] Jul 21 18:42:51.039323 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039306 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="feast-init" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039325 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="feast-init" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039338 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="offline" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039344 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="offline" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039353 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="feast-apply" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039358 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="feast-apply" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039364 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039369 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039374 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="feast-apply" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039379 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="feast-apply" Jul 21 18:42:51.039382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039384 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039390 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039399 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039404 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039411 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="feast-init" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039416 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="feast-init" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039423 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="registry" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039427 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="registry" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039434 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="offline" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039438 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="offline" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039445 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039450 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039502 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="online" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039510 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="offline" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039515 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb20cc97-7e86-4435-b39e-693e906621c8" containerName="ui" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039520 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="online" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039525 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="ui" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039532 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="registry" Jul 21 18:42:51.039679 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.039539 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad9d6ca-00dc-4ad7-a0f1-dc7d23323e29" containerName="offline" Jul 21 18:42:51.044515 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.044489 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.051412 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.051392 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 21 18:42:51.058403 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.058381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jul 21 18:42:51.061227 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.061209 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-42qmz\"" Jul 21 18:42:51.079766 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.079741 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-7fl97"] Jul 21 18:42:51.085185 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.085161 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 21 18:42:51.093531 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.093494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:51.210007 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.209970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f121d130-1d2f-4e67-892f-0758b9ea9b77-postgresdata\") pod \"postgres-864846d4f5-7fl97\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.210221 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.210046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd8nt\" (UniqueName: \"kubernetes.io/projected/f121d130-1d2f-4e67-892f-0758b9ea9b77-kube-api-access-gd8nt\") pod \"postgres-864846d4f5-7fl97\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.280323 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.280288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:42:51.311495 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.311411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd8nt\" (UniqueName: \"kubernetes.io/projected/f121d130-1d2f-4e67-892f-0758b9ea9b77-kube-api-access-gd8nt\") pod \"postgres-864846d4f5-7fl97\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.311495 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.311464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f121d130-1d2f-4e67-892f-0758b9ea9b77-postgresdata\") pod \"postgres-864846d4f5-7fl97\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.311828 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.311810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f121d130-1d2f-4e67-892f-0758b9ea9b77-postgresdata\") pod \"postgres-864846d4f5-7fl97\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.324464 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.324429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd8nt\" (UniqueName: \"kubernetes.io/projected/f121d130-1d2f-4e67-892f-0758b9ea9b77-kube-api-access-gd8nt\") pod \"postgres-864846d4f5-7fl97\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.372430 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.372395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:42:51.515963 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.515932 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-7fl97"] Jul 21 18:42:51.519062 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:42:51.519033 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf121d130_1d2f_4e67_892f_0758b9ea9b77.slice/crio-1139df9897c30f72f9fbab5af626f9bffda1ed7f69e625e9b3cc40603af771aa WatchSource:0}: Error finding container 1139df9897c30f72f9fbab5af626f9bffda1ed7f69e625e9b3cc40603af771aa: Status 404 returned error can't find the container with id 1139df9897c30f72f9fbab5af626f9bffda1ed7f69e625e9b3cc40603af771aa Jul 21 18:42:51.520887 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.520871 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 18:42:51.851694 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:51.851661 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-7fl97" event={"ID":"f121d130-1d2f-4e67-892f-0758b9ea9b77","Type":"ContainerStarted","Data":"1139df9897c30f72f9fbab5af626f9bffda1ed7f69e625e9b3cc40603af771aa"} Jul 21 18:42:57.880503 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:57.880458 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-7fl97" event={"ID":"f121d130-1d2f-4e67-892f-0758b9ea9b77","Type":"ContainerStarted","Data":"43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d"} Jul 21 18:42:57.898947 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:42:57.898899 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-7fl97" podStartSLOduration=1.6180537149999998 podStartE2EDuration="7.898883124s" totalImagesPullingTime="6.280829409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:42:57.897535908 +0000 UTC m=+763.831174304" watchObservedRunningTime="2026-07-21 18:42:57.898883124 +0000 UTC m=+763.832521518" Jul 21 18:43:01.686203 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.686158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:43:01.788739 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.788699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:43:01.808816 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.808786 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6"] Jul 21 18:43:01.815006 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.814982 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:01.817774 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.817742 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Jul 21 18:43:01.818105 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.818074 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Jul 21 18:43:01.818234 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.818169 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 21 18:43:01.818448 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.818434 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-b9gqt\"" Jul 21 18:43:01.818628 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.818612 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Jul 21 18:43:01.828765 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.828742 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6"] Jul 21 18:43:01.900302 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.900266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:43:01.900844 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.900819 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-registry-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:01.900957 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.900869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5da5b1-c682-41bd-9426-817839e5cbba-feast-data\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:01.901016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.900951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-offline-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:01.901016 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.900996 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-online-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:01.901134 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:01.901052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfxx\" (UniqueName: \"kubernetes.io/projected/0e5da5b1-c682-41bd-9426-817839e5cbba-kube-api-access-wbfxx\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.000114 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.000009 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:43:02.001976 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.001956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-online-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.002116 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.002005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfxx\" (UniqueName: \"kubernetes.io/projected/0e5da5b1-c682-41bd-9426-817839e5cbba-kube-api-access-wbfxx\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.002116 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.002054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-registry-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.002116 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.002084 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5da5b1-c682-41bd-9426-817839e5cbba-feast-data\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.002280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.002125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-offline-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.002452 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.002430 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5da5b1-c682-41bd-9426-817839e5cbba-feast-data\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.004741 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.004717 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-online-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.004890 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.004860 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-offline-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.004935 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.004871 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-registry-tls\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.012105 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.012059 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfxx\" (UniqueName: \"kubernetes.io/projected/0e5da5b1-c682-41bd-9426-817839e5cbba-kube-api-access-wbfxx\") pod \"feast-credit-scoring-db5d8ff98-fbgm6\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.080735 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.080696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:43:02.126888 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.126852 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:02.276191 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.276157 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6"] Jul 21 18:43:02.279410 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:43:02.279382 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5da5b1_c682_41bd_9426_817839e5cbba.slice/crio-fe56d373cc7036d346fc4f1a17635ab3168d8692a053bcb7a2d10b0cc74be7c1 WatchSource:0}: Error finding container fe56d373cc7036d346fc4f1a17635ab3168d8692a053bcb7a2d10b0cc74be7c1: Status 404 returned error can't find the container with id fe56d373cc7036d346fc4f1a17635ab3168d8692a053bcb7a2d10b0cc74be7c1 Jul 21 18:43:02.902420 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.902388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerStarted","Data":"68274719209ebeb7ed005348208856c9f8dd8670e42a37563d2de820b774053f"} Jul 21 18:43:02.902797 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:02.902442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerStarted","Data":"fe56d373cc7036d346fc4f1a17635ab3168d8692a053bcb7a2d10b0cc74be7c1"} Jul 21 18:43:03.913160 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:03.913126 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerID="68274719209ebeb7ed005348208856c9f8dd8670e42a37563d2de820b774053f" exitCode=0 Jul 21 18:43:03.913580 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:03.913189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerDied","Data":"68274719209ebeb7ed005348208856c9f8dd8670e42a37563d2de820b774053f"} Jul 21 18:43:04.918741 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:04.918703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerStarted","Data":"99fc86afe3a137a931aacaed87e623e28593ac695e1239a1eb411b9945026726"} Jul 21 18:43:10.952740 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:10.952707 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerID="99fc86afe3a137a931aacaed87e623e28593ac695e1239a1eb411b9945026726" exitCode=0 Jul 21 18:43:10.953169 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:10.952748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerDied","Data":"99fc86afe3a137a931aacaed87e623e28593ac695e1239a1eb411b9945026726"} Jul 21 18:43:11.961506 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:11.961471 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerStarted","Data":"75bad6ddbf9eef27d506d8a362c204e74cf03b64abb3fb782e5579485baf5cb4"} Jul 21 18:43:11.961993 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:11.961538 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerStarted","Data":"946cb88ee8434c3250baa996457163a2d59414c362809f1ae5dcc5734404a9fb"} Jul 21 18:43:11.961993 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:11.961561 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerStarted","Data":"f3ef512fe2887dbc00b5eaa190c2b18fb3a94d6fa3cc8ed61b3e9d3e5445e374"} Jul 21 18:43:12.000322 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:12.000258 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podStartSLOduration=11.00023517 podStartE2EDuration="11.00023517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:43:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:43:11.998728596 +0000 UTC m=+777.932366990" watchObservedRunningTime="2026-07-21 18:43:12.00023517 +0000 UTC m=+777.933873565" Jul 21 18:43:12.127367 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:12.127325 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:12.127540 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:12.127437 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:12.127540 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:12.127476 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:14.127208 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:14.127143 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:14.127684 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:14.127225 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:14.127684 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:14.127252 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:14.128951 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:14.128918 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Jul 21 18:43:14.129075 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:14.128946 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Jul 21 18:43:14.129075 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:14.128967 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 21 18:43:17.127667 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:17.127621 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Jul 21 18:43:17.128311 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:17.128287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:17.129254 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:17.129229 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:17.504372 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:17.504290 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:17.998218 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:17.998176 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:20.127824 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:20.127782 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Jul 21 18:43:23.128244 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:23.128209 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:23.129033 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:23.129013 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:43:23.428241 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:43:23.428142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:44:23.206473 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:23.206436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:44:28.182781 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.182742 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6"] Jul 21 18:44:28.183255 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.182992 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" containerID="cri-o://f3ef512fe2887dbc00b5eaa190c2b18fb3a94d6fa3cc8ed61b3e9d3e5445e374" gracePeriod=30 Jul 21 18:44:28.183255 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.183116 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="offline" containerID="cri-o://75bad6ddbf9eef27d506d8a362c204e74cf03b64abb3fb782e5579485baf5cb4" gracePeriod=30 Jul 21 18:44:28.183255 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.183113 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" containerID="cri-o://946cb88ee8434c3250baa996457163a2d59414c362809f1ae5dcc5734404a9fb" gracePeriod=30 Jul 21 18:44:28.199465 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.199426 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-7fl97"] Jul 21 18:44:28.199672 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.199648 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-7fl97" podUID="f121d130-1d2f-4e67-892f-0758b9ea9b77" containerName="postgres" containerID="cri-o://43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d" gracePeriod=30 Jul 21 18:44:28.277490 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.277458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:44:28.445508 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.445445 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:44:28.500898 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.500868 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd8nt\" (UniqueName: \"kubernetes.io/projected/f121d130-1d2f-4e67-892f-0758b9ea9b77-kube-api-access-gd8nt\") pod \"f121d130-1d2f-4e67-892f-0758b9ea9b77\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " Jul 21 18:44:28.501104 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.500934 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f121d130-1d2f-4e67-892f-0758b9ea9b77-postgresdata\") pod \"f121d130-1d2f-4e67-892f-0758b9ea9b77\" (UID: \"f121d130-1d2f-4e67-892f-0758b9ea9b77\") " Jul 21 18:44:28.503407 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.503372 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f121d130-1d2f-4e67-892f-0758b9ea9b77-kube-api-access-gd8nt" (OuterVolumeSpecName: "kube-api-access-gd8nt") pod "f121d130-1d2f-4e67-892f-0758b9ea9b77" (UID: "f121d130-1d2f-4e67-892f-0758b9ea9b77"). InnerVolumeSpecName "kube-api-access-gd8nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:44:28.533523 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.533474 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f121d130-1d2f-4e67-892f-0758b9ea9b77-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "f121d130-1d2f-4e67-892f-0758b9ea9b77" (UID: "f121d130-1d2f-4e67-892f-0758b9ea9b77"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:44:28.601993 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.601955 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd8nt\" (UniqueName: \"kubernetes.io/projected/f121d130-1d2f-4e67-892f-0758b9ea9b77-kube-api-access-gd8nt\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:28.601993 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:28.601986 2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f121d130-1d2f-4e67-892f-0758b9ea9b77-postgresdata\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:29.296165 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.296134 2565 generic.go:356] "Generic (PLEG): container finished" podID="f121d130-1d2f-4e67-892f-0758b9ea9b77" containerID="43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d" exitCode=0 Jul 21 18:44:29.296664 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.296185 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-7fl97" Jul 21 18:44:29.296664 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.296224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-7fl97" event={"ID":"f121d130-1d2f-4e67-892f-0758b9ea9b77","Type":"ContainerDied","Data":"43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d"} Jul 21 18:44:29.296664 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.296265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-7fl97" event={"ID":"f121d130-1d2f-4e67-892f-0758b9ea9b77","Type":"ContainerDied","Data":"1139df9897c30f72f9fbab5af626f9bffda1ed7f69e625e9b3cc40603af771aa"} Jul 21 18:44:29.296664 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.296286 2565 scope.go:117] "RemoveContainer" containerID="43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d" Jul 21 18:44:29.299601 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.299577 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerID="946cb88ee8434c3250baa996457163a2d59414c362809f1ae5dcc5734404a9fb" exitCode=0 Jul 21 18:44:29.299719 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.299616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerDied","Data":"946cb88ee8434c3250baa996457163a2d59414c362809f1ae5dcc5734404a9fb"} Jul 21 18:44:29.304841 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.304821 2565 scope.go:117] "RemoveContainer" containerID="43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d" Jul 21 18:44:29.305155 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:44:29.305133 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d\": container with ID starting with 43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d not found: ID does not exist" containerID="43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d" Jul 21 18:44:29.305228 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.305169 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d"} err="failed to get container status \"43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d\": rpc error: code = NotFound desc = could not find container \"43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d\": container with ID starting with 43ec3d4b71ebc9a61177c58c939b577872914dc578cf179560cbf108b7a5818d not found: ID does not exist" Jul 21 18:44:29.311057 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.311029 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-7fl97"] Jul 21 18:44:29.314314 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:29.314294 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-7fl97"] Jul 21 18:44:30.557345 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:30.557311 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f121d130-1d2f-4e67-892f-0758b9ea9b77" path="/var/lib/kubelet/pods/f121d130-1d2f-4e67-892f-0758b9ea9b77/volumes" Jul 21 18:44:37.995953 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:37.995912 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 21 18:44:47.995294 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:47.995252 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 21 18:44:57.995530 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:57.995487 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Jul 21 18:44:57.995977 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:57.995621 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:44:58.419570 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.419540 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerID="75bad6ddbf9eef27d506d8a362c204e74cf03b64abb3fb782e5579485baf5cb4" exitCode=137 Jul 21 18:44:58.419570 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.419562 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerID="f3ef512fe2887dbc00b5eaa190c2b18fb3a94d6fa3cc8ed61b3e9d3e5445e374" exitCode=137 Jul 21 18:44:58.419780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.419618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerDied","Data":"75bad6ddbf9eef27d506d8a362c204e74cf03b64abb3fb782e5579485baf5cb4"} Jul 21 18:44:58.419780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.419683 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerDied","Data":"f3ef512fe2887dbc00b5eaa190c2b18fb3a94d6fa3cc8ed61b3e9d3e5445e374"} Jul 21 18:44:58.836539 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.836516 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:44:58.951820 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.951728 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5da5b1-c682-41bd-9426-817839e5cbba-feast-data\") pod \"0e5da5b1-c682-41bd-9426-817839e5cbba\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " Jul 21 18:44:58.951820 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.951775 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbfxx\" (UniqueName: \"kubernetes.io/projected/0e5da5b1-c682-41bd-9426-817839e5cbba-kube-api-access-wbfxx\") pod \"0e5da5b1-c682-41bd-9426-817839e5cbba\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " Jul 21 18:44:58.951820 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.951798 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-online-tls\") pod \"0e5da5b1-c682-41bd-9426-817839e5cbba\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " Jul 21 18:44:58.952150 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.951840 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-registry-tls\") pod \"0e5da5b1-c682-41bd-9426-817839e5cbba\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " Jul 21 18:44:58.952150 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.951884 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-offline-tls\") pod \"0e5da5b1-c682-41bd-9426-817839e5cbba\" (UID: \"0e5da5b1-c682-41bd-9426-817839e5cbba\") " Jul 21 18:44:58.954237 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.954188 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e5da5b1-c682-41bd-9426-817839e5cbba-kube-api-access-wbfxx" (OuterVolumeSpecName: "kube-api-access-wbfxx") pod "0e5da5b1-c682-41bd-9426-817839e5cbba" (UID: "0e5da5b1-c682-41bd-9426-817839e5cbba"). InnerVolumeSpecName "kube-api-access-wbfxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:44:58.954364 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.954235 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-online-tls" (OuterVolumeSpecName: "online-tls") pod "0e5da5b1-c682-41bd-9426-817839e5cbba" (UID: "0e5da5b1-c682-41bd-9426-817839e5cbba"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:44:58.954364 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.954283 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0e5da5b1-c682-41bd-9426-817839e5cbba" (UID: "0e5da5b1-c682-41bd-9426-817839e5cbba"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:44:58.954483 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.954382 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0e5da5b1-c682-41bd-9426-817839e5cbba" (UID: "0e5da5b1-c682-41bd-9426-817839e5cbba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:44:58.960318 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:58.960284 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e5da5b1-c682-41bd-9426-817839e5cbba-feast-data" (OuterVolumeSpecName: "feast-data") pod "0e5da5b1-c682-41bd-9426-817839e5cbba" (UID: "0e5da5b1-c682-41bd-9426-817839e5cbba"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:44:59.052744 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.052712 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-offline-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:59.052744 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.052740 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e5da5b1-c682-41bd-9426-817839e5cbba-feast-data\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:59.052744 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.052752 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbfxx\" (UniqueName: \"kubernetes.io/projected/0e5da5b1-c682-41bd-9426-817839e5cbba-kube-api-access-wbfxx\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:59.053237 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.052789 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-online-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:59.053237 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.052802 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0e5da5b1-c682-41bd-9426-817839e5cbba-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:44:59.426611 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.426574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" event={"ID":"0e5da5b1-c682-41bd-9426-817839e5cbba","Type":"ContainerDied","Data":"fe56d373cc7036d346fc4f1a17635ab3168d8692a053bcb7a2d10b0cc74be7c1"} Jul 21 18:44:59.426611 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.426609 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6" Jul 21 18:44:59.426831 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.426641 2565 scope.go:117] "RemoveContainer" containerID="75bad6ddbf9eef27d506d8a362c204e74cf03b64abb3fb782e5579485baf5cb4" Jul 21 18:44:59.435846 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.435828 2565 scope.go:117] "RemoveContainer" containerID="946cb88ee8434c3250baa996457163a2d59414c362809f1ae5dcc5734404a9fb" Jul 21 18:44:59.444336 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.444315 2565 scope.go:117] "RemoveContainer" containerID="f3ef512fe2887dbc00b5eaa190c2b18fb3a94d6fa3cc8ed61b3e9d3e5445e374" Jul 21 18:44:59.450274 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.450243 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6"] Jul 21 18:44:59.453691 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.453665 2565 scope.go:117] "RemoveContainer" containerID="99fc86afe3a137a931aacaed87e623e28593ac695e1239a1eb411b9945026726" Jul 21 18:44:59.454845 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.454823 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-db5d8ff98-fbgm6"] Jul 21 18:44:59.462004 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:44:59.461981 2565 scope.go:117] "RemoveContainer" containerID="68274719209ebeb7ed005348208856c9f8dd8670e42a37563d2de820b774053f" Jul 21 18:45:00.557449 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:00.557407 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" path="/var/lib/kubelet/pods/0e5da5b1-c682-41bd-9426-817839e5cbba/volumes" Jul 21 18:45:05.375441 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:05.375403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:45:07.266156 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:07.266120 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:45:14.484368 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:14.484333 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:45:14.484928 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:14.484909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:45:14.489029 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:14.489011 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:45:14.489194 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:45:14.489178 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:47:04.107065 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.106978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:04.221971 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.221926 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:04.372966 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.372886 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-kb8rh"] Jul 21 18:47:04.373274 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373258 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373277 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373307 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f121d130-1d2f-4e67-892f-0758b9ea9b77" containerName="postgres" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373316 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f121d130-1d2f-4e67-892f-0758b9ea9b77" containerName="postgres" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373328 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="feast-init" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373335 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="feast-init" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373346 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="offline" Jul 21 18:47:04.373361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373354 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="offline" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373368 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373376 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373388 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="feast-apply" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373396 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="feast-apply" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373469 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f121d130-1d2f-4e67-892f-0758b9ea9b77" containerName="postgres" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373481 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="registry" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373493 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="online" Jul 21 18:47:04.373692 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.373503 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e5da5b1-c682-41bd-9426-817839e5cbba" containerName="offline" Jul 21 18:47:04.376466 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.376447 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:47:04.378975 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.378953 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jul 21 18:47:04.379172 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.379153 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jul 21 18:47:04.380228 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.380208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-fj5ww\"" Jul 21 18:47:04.393452 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.393425 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-kb8rh"] Jul 21 18:47:04.409997 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.409947 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:04.432346 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.432308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knx6r\" (UniqueName: \"kubernetes.io/projected/76edc020-7848-45a2-a1c1-b4f47f81f2c5-kube-api-access-knx6r\") pod \"redis-69bbd798b6-kb8rh\" (UID: \"76edc020-7848-45a2-a1c1-b4f47f81f2c5\") " pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:47:04.533776 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.533736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knx6r\" (UniqueName: \"kubernetes.io/projected/76edc020-7848-45a2-a1c1-b4f47f81f2c5-kube-api-access-knx6r\") pod \"redis-69bbd798b6-kb8rh\" (UID: \"76edc020-7848-45a2-a1c1-b4f47f81f2c5\") " pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:47:04.544319 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.544289 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knx6r\" (UniqueName: \"kubernetes.io/projected/76edc020-7848-45a2-a1c1-b4f47f81f2c5-kube-api-access-knx6r\") pod \"redis-69bbd798b6-kb8rh\" (UID: \"76edc020-7848-45a2-a1c1-b4f47f81f2c5\") " pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:47:04.669836 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.669760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:04.698124 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.698072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:47:04.834260 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.834215 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-kb8rh"] Jul 21 18:47:04.838263 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:47:04.838224 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76edc020_7848_45a2_a1c1_b4f47f81f2c5.slice/crio-1d2298b6bbed5574fd69d4aa57c205047f1451c562c5fea3a18949a478133cba WatchSource:0}: Error finding container 1d2298b6bbed5574fd69d4aa57c205047f1451c562c5fea3a18949a478133cba: Status 404 returned error can't find the container with id 1d2298b6bbed5574fd69d4aa57c205047f1451c562c5fea3a18949a478133cba Jul 21 18:47:04.901100 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:04.901040 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" event={"ID":"76edc020-7848-45a2-a1c1-b4f47f81f2c5","Type":"ContainerStarted","Data":"1d2298b6bbed5574fd69d4aa57c205047f1451c562c5fea3a18949a478133cba"} Jul 21 18:47:06.911026 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:06.910983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" event={"ID":"76edc020-7848-45a2-a1c1-b4f47f81f2c5","Type":"ContainerStarted","Data":"11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1"} Jul 21 18:47:06.926382 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:06.926327 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" podStartSLOduration=1.334988229 podStartE2EDuration="2.9263091s" totalImagesPullingTime="1.591320871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:47:06.925623929 +0000 UTC m=+1012.859262324" watchObservedRunningTime="2026-07-21 18:47:06.9263091 +0000 UTC m=+1012.859947494" Jul 21 18:47:09.814114 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.814047 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d222b"] Jul 21 18:47:09.817375 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.817355 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:09.820259 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.820228 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jul 21 18:47:09.825724 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.825698 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d222b"] Jul 21 18:47:09.851141 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.851112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:09.879978 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.879948 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnp7k\" (UniqueName: \"kubernetes.io/projected/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-kube-api-access-gnp7k\") pod \"postgres-864846d4f5-d222b\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:09.880154 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.880003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-postgresdata\") pod \"postgres-864846d4f5-d222b\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:09.980890 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.980854 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnp7k\" (UniqueName: \"kubernetes.io/projected/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-kube-api-access-gnp7k\") pod \"postgres-864846d4f5-d222b\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:09.981042 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.980926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-postgresdata\") pod \"postgres-864846d4f5-d222b\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:09.981361 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.981342 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-postgresdata\") pod \"postgres-864846d4f5-d222b\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:09.990076 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:09.990041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnp7k\" (UniqueName: \"kubernetes.io/projected/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-kube-api-access-gnp7k\") pod \"postgres-864846d4f5-d222b\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:10.128051 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:10.127963 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:47:10.260798 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:10.260775 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d222b"] Jul 21 18:47:10.263234 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:47:10.263198 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10d1ffee_f72b_475f_bda1_2dcc30c49fd5.slice/crio-6695789c6aa4f9cb80b122b9c9b16d982f4c64332ec5dcd35dd1359b7286ba9c WatchSource:0}: Error finding container 6695789c6aa4f9cb80b122b9c9b16d982f4c64332ec5dcd35dd1359b7286ba9c: Status 404 returned error can't find the container with id 6695789c6aa4f9cb80b122b9c9b16d982f4c64332ec5dcd35dd1359b7286ba9c Jul 21 18:47:10.927843 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:10.927810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" event={"ID":"10d1ffee-f72b-475f-bda1-2dcc30c49fd5","Type":"ContainerStarted","Data":"c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8"} Jul 21 18:47:10.927843 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:10.927850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" event={"ID":"10d1ffee-f72b-475f-bda1-2dcc30c49fd5","Type":"ContainerStarted","Data":"6695789c6aa4f9cb80b122b9c9b16d982f4c64332ec5dcd35dd1359b7286ba9c"} Jul 21 18:47:10.944368 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:10.944311 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" podStartSLOduration=1.944290118 podStartE2EDuration="1.944290118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:47:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:47:10.943408902 +0000 UTC m=+1016.877047296" watchObservedRunningTime="2026-07-21 18:47:10.944290118 +0000 UTC m=+1016.877928513" Jul 21 18:47:15.279591 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.279557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:15.378851 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.378816 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:15.446616 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.446582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:15.451420 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.451396 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5"] Jul 21 18:47:15.461359 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.461333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.464559 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.464528 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Jul 21 18:47:15.464677 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.464589 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-nlfm4\"" Jul 21 18:47:15.464677 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.464605 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Jul 21 18:47:15.464677 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.464537 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Jul 21 18:47:15.467988 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.467967 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5"] Jul 21 18:47:15.527339 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.527305 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbtf\" (UniqueName: \"kubernetes.io/projected/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-kube-api-access-wpbtf\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.527522 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.527353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-online-tls\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.527522 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.527388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-feast-data\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.527522 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.527420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-registry-tls\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.627935 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.627824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-online-tls\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.627935 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.627889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-feast-data\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.627935 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.627911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-registry-tls\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.628280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.628002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbtf\" (UniqueName: \"kubernetes.io/projected/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-kube-api-access-wpbtf\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.628381 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.628355 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-feast-data\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.630683 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.630661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-online-tls\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.630782 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.630702 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-registry-tls\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.636672 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.636647 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbtf\" (UniqueName: \"kubernetes.io/projected/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-kube-api-access-wpbtf\") pod \"feast-credit-scoring-6ffc5c5d49-wstk5\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.772326 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.772288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:15.916655 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.916559 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5"] Jul 21 18:47:15.919413 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:47:15.919378 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3739d9_510f_4e9f_9d3a_c95ab3381c6c.slice/crio-58fef2f11a524af6699e9e0242ba5008a54ff3fb6752ac56662ba6bf240514f5 WatchSource:0}: Error finding container 58fef2f11a524af6699e9e0242ba5008a54ff3fb6752ac56662ba6bf240514f5: Status 404 returned error can't find the container with id 58fef2f11a524af6699e9e0242ba5008a54ff3fb6752ac56662ba6bf240514f5 Jul 21 18:47:15.947525 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:15.947486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerStarted","Data":"58fef2f11a524af6699e9e0242ba5008a54ff3fb6752ac56662ba6bf240514f5"} Jul 21 18:47:16.952979 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:16.952945 2565 generic.go:356] "Generic (PLEG): container finished" podID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerID="c634e95f333a5404d4fcc5e59226c7d391f036cf5d2e29e1969652cff71f4e65" exitCode=0 Jul 21 18:47:16.953418 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:16.953048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerDied","Data":"c634e95f333a5404d4fcc5e59226c7d391f036cf5d2e29e1969652cff71f4e65"} Jul 21 18:47:17.958921 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:17.958889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerStarted","Data":"553ca1d629ab796d03dad12b93817b64318778165a73c0d5c440c1516d8f3413"} Jul 21 18:47:24.992129 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:24.992071 2565 generic.go:356] "Generic (PLEG): container finished" podID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerID="553ca1d629ab796d03dad12b93817b64318778165a73c0d5c440c1516d8f3413" exitCode=0 Jul 21 18:47:24.992530 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:24.992159 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerDied","Data":"553ca1d629ab796d03dad12b93817b64318778165a73c0d5c440c1516d8f3413"} Jul 21 18:47:25.999983 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:25.999946 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerStarted","Data":"bc6fc4fee974c3e76d1dab079e48b8862f311c77bbfbf703f5e50d461b0edeeb"} Jul 21 18:47:26.000391 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:26.000004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerStarted","Data":"d63c17d96245f8a2b0ac639f8d8272670e7cba075e3ca893531c75cd4afdaeb3"} Jul 21 18:47:26.026364 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:26.026314 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podStartSLOduration=11.0262936 podStartE2EDuration="11.0262936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:47:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:47:26.024736884 +0000 UTC m=+1031.958375301" watchObservedRunningTime="2026-07-21 18:47:26.0262936 +0000 UTC m=+1031.959931999" Jul 21 18:47:27.772654 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:27.772611 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:27.773176 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:27.772722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:27.774355 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:27.774315 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 21 18:47:27.774493 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:27.774361 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 21 18:47:30.773045 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:30.772991 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 21 18:47:30.773507 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:30.773039 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 21 18:47:33.773458 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:33.773399 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 21 18:47:33.779103 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:33.779053 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:33.779522 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:33.779498 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:33.782687 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:33.782659 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:35.773125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:35.773051 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:36.772888 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:36.772847 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 21 18:47:39.773166 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:39.773134 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:39.773956 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:39.773938 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:47:40.045932 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:40.045831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:41.130862 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.130821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:41.213043 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.213007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:41.221075 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.221046 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp"] Jul 21 18:47:41.225079 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.225059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.227731 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.227691 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Jul 21 18:47:41.227842 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.227736 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-n7c97\"" Jul 21 18:47:41.227842 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.227805 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Jul 21 18:47:41.227842 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.227691 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Jul 21 18:47:41.235683 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.235655 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp"] Jul 21 18:47:41.343852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.343817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztbh8\" (UniqueName: \"kubernetes.io/projected/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-kube-api-access-ztbh8\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.343852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.343864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-feast-data\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.344114 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.343982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.344114 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.344038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-online-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.365290 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.365257 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:41.444528 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.444437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.444528 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.444479 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-online-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.444772 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:47:41.444602 2565 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Jul 21 18:47:41.444772 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.444640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztbh8\" (UniqueName: \"kubernetes.io/projected/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-kube-api-access-ztbh8\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.444772 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:47:41.444676 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls podName:6a5c793e-2f43-48bc-a0d2-dd89ebb01504 nodeName:}" failed. No retries permitted until 2026-07-21 18:47:41.944655518 +0000 UTC m=+1047.878293892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls") pod "feast-driver-ranking-67c5b9fbdb-bhxdp" (UID: "6a5c793e-2f43-48bc-a0d2-dd89ebb01504") : secret "feast-driver-ranking-registry-tls" not found Jul 21 18:47:41.444772 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.444710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-feast-data\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.445147 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.445123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-feast-data\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.447100 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.447065 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-online-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.453816 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.453791 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztbh8\" (UniqueName: \"kubernetes.io/projected/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-kube-api-access-ztbh8\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.643177 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.643135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:47:41.949987 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.949953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:41.952571 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:41.952546 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls\") pod \"feast-driver-ranking-67c5b9fbdb-bhxdp\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:42.135294 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:42.135255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:42.278168 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:42.278141 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp"] Jul 21 18:47:42.279840 ip-10-0-137-12 kubenswrapper[2565]: W0721 18:47:42.279815 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5c793e_2f43_48bc_a0d2_dd89ebb01504.slice/crio-116fc1a6da4382a2e0c7c74cc1abf9dce81087b261d39df9667533793ec709de WatchSource:0}: Error finding container 116fc1a6da4382a2e0c7c74cc1abf9dce81087b261d39df9667533793ec709de: Status 404 returned error can't find the container with id 116fc1a6da4382a2e0c7c74cc1abf9dce81087b261d39df9667533793ec709de Jul 21 18:47:43.081154 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:43.081120 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerStarted","Data":"5b1923b4fb9b5f23f84de53108f74319ecf67cf81d8a1f338147a443f1d5d13e"} Jul 21 18:47:43.081348 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:43.081176 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerStarted","Data":"116fc1a6da4382a2e0c7c74cc1abf9dce81087b261d39df9667533793ec709de"} Jul 21 18:47:48.102690 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:48.102656 2565 generic.go:356] "Generic (PLEG): container finished" podID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerID="5b1923b4fb9b5f23f84de53108f74319ecf67cf81d8a1f338147a443f1d5d13e" exitCode=0 Jul 21 18:47:48.103125 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:48.102715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerDied","Data":"5b1923b4fb9b5f23f84de53108f74319ecf67cf81d8a1f338147a443f1d5d13e"} Jul 21 18:47:49.108241 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:49.108196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerStarted","Data":"40adf5bc745672deb10e6da47c289c53c8f875a6f7fe28777f8bd7852a6f459d"} Jul 21 18:47:55.136194 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:55.136160 2565 generic.go:356] "Generic (PLEG): container finished" podID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerID="40adf5bc745672deb10e6da47c289c53c8f875a6f7fe28777f8bd7852a6f459d" exitCode=0 Jul 21 18:47:55.136595 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:55.136234 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerDied","Data":"40adf5bc745672deb10e6da47c289c53c8f875a6f7fe28777f8bd7852a6f459d"} Jul 21 18:47:56.144198 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:56.144166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerStarted","Data":"974f3c1a5ddd6179fedc9e73d5f86c057d671f6e1bf72ed8535d482be6604db1"} Jul 21 18:47:56.144556 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:56.144221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerStarted","Data":"8895f4c9512b8d1c39c83e785cc6daed94c2fe18efa9fcf0b4f6cecca923e56e"} Jul 21 18:47:56.174174 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:56.174111 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podStartSLOduration=15.174064071 podStartE2EDuration="15.174064071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 18:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:47:56.172554392 +0000 UTC m=+1062.106192789" watchObservedRunningTime="2026-07-21 18:47:56.174064071 +0000 UTC m=+1062.107702464" Jul 21 18:47:57.136058 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:57.136019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:57.136230 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:57.136112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:47:57.137530 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:57.137492 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Jul 21 18:47:57.144259 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:47:57.137835 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Jul 21 18:48:00.135852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:00.135811 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Jul 21 18:48:00.135852 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:00.135826 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Jul 21 18:48:02.136180 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:02.136140 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:48:02.136696 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:02.136210 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:48:03.136048 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:03.136000 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Jul 21 18:48:03.144236 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:03.144209 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:48:03.148915 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:03.148890 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:48:06.136221 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:06.136116 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.33:6571: connect: connection refused" Jul 21 18:48:09.136876 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:09.136842 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:48:09.137672 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:09.137649 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:48:25.418038 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:25.417997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:48:25.489715 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:25.489678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:48:35.557467 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:35.557433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:48:35.617761 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:48:35.617731 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:24.762243 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:24.762212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:26.682559 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:26.682520 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:27.032997 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.032968 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr"] Jul 21 18:49:27.033254 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.033229 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" podUID="65d8bb34-bbae-4d71-b6c7-4914e44a9e93" containerName="manager" containerID="cri-o://205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2" gracePeriod=10 Jul 21 18:49:27.051427 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.051391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:27.183972 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.183939 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:49:27.233233 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.233205 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsghm\" (UniqueName: \"kubernetes.io/projected/65d8bb34-bbae-4d71-b6c7-4914e44a9e93-kube-api-access-xsghm\") pod \"65d8bb34-bbae-4d71-b6c7-4914e44a9e93\" (UID: \"65d8bb34-bbae-4d71-b6c7-4914e44a9e93\") " Jul 21 18:49:27.235716 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.235681 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65d8bb34-bbae-4d71-b6c7-4914e44a9e93-kube-api-access-xsghm" (OuterVolumeSpecName: "kube-api-access-xsghm") pod "65d8bb34-bbae-4d71-b6c7-4914e44a9e93" (UID: "65d8bb34-bbae-4d71-b6c7-4914e44a9e93"). InnerVolumeSpecName "kube-api-access-xsghm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:49:27.280110 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.280059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:27.318209 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.318176 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp"] Jul 21 18:49:27.318500 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.318460 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" containerID="cri-o://8895f4c9512b8d1c39c83e785cc6daed94c2fe18efa9fcf0b4f6cecca923e56e" gracePeriod=30 Jul 21 18:49:27.318641 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.318548 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" containerID="cri-o://974f3c1a5ddd6179fedc9e73d5f86c057d671f6e1bf72ed8535d482be6604db1" gracePeriod=30 Jul 21 18:49:27.321684 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.321654 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5"] Jul 21 18:49:27.322138 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.322109 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" containerID="cri-o://d63c17d96245f8a2b0ac639f8d8272670e7cba075e3ca893531c75cd4afdaeb3" gracePeriod=30 Jul 21 18:49:27.322471 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.322448 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" containerID="cri-o://bc6fc4fee974c3e76d1dab079e48b8862f311c77bbfbf703f5e50d461b0edeeb" gracePeriod=30 Jul 21 18:49:27.333811 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.333784 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsghm\" (UniqueName: \"kubernetes.io/projected/65d8bb34-bbae-4d71-b6c7-4914e44a9e93-kube-api-access-xsghm\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:27.361247 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.361187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:27.549620 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.549521 2565 generic.go:356] "Generic (PLEG): container finished" podID="65d8bb34-bbae-4d71-b6c7-4914e44a9e93" containerID="205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2" exitCode=0 Jul 21 18:49:27.549620 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.549576 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" Jul 21 18:49:27.549620 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.549599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" event={"ID":"65d8bb34-bbae-4d71-b6c7-4914e44a9e93","Type":"ContainerDied","Data":"205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2"} Jul 21 18:49:27.549893 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.549678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr" event={"ID":"65d8bb34-bbae-4d71-b6c7-4914e44a9e93","Type":"ContainerDied","Data":"883d05a1e4cd7990846aee721cef0f7f7850283be4e3c8a14e79ad0dac9700bc"} Jul 21 18:49:27.549893 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.549708 2565 scope.go:117] "RemoveContainer" containerID="205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2" Jul 21 18:49:27.562129 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.562071 2565 scope.go:117] "RemoveContainer" containerID="205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2" Jul 21 18:49:27.562609 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:49:27.562536 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2\": container with ID starting with 205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2 not found: ID does not exist" containerID="205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2" Jul 21 18:49:27.562609 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.562573 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2"} err="failed to get container status \"205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2\": rpc error: code = NotFound desc = could not find container \"205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2\": container with ID starting with 205ab96b953b2dfb3df5c8a05363cb1421289c2efd99896d9ed782d26027aee2 not found: ID does not exist" Jul 21 18:49:27.588175 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.588142 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr"] Jul 21 18:49:27.592415 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:27.592389 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7fc4b879bb-56gfr"] Jul 21 18:49:28.556750 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:28.556712 2565 generic.go:356] "Generic (PLEG): container finished" podID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerID="bc6fc4fee974c3e76d1dab079e48b8862f311c77bbfbf703f5e50d461b0edeeb" exitCode=0 Jul 21 18:49:28.557173 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:28.557048 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65d8bb34-bbae-4d71-b6c7-4914e44a9e93" path="/var/lib/kubelet/pods/65d8bb34-bbae-4d71-b6c7-4914e44a9e93/volumes" Jul 21 18:49:28.557391 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:28.557368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerDied","Data":"bc6fc4fee974c3e76d1dab079e48b8862f311c77bbfbf703f5e50d461b0edeeb"} Jul 21 18:49:28.559756 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:28.559734 2565 generic.go:356] "Generic (PLEG): container finished" podID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerID="974f3c1a5ddd6179fedc9e73d5f86c057d671f6e1bf72ed8535d482be6604db1" exitCode=0 Jul 21 18:49:28.559865 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:28.559793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerDied","Data":"974f3c1a5ddd6179fedc9e73d5f86c057d671f6e1bf72ed8535d482be6604db1"} Jul 21 18:49:29.737015 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:29.736982 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d222b"] Jul 21 18:49:29.737488 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:29.737157 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" podUID="10d1ffee-f72b-475f-bda1-2dcc30c49fd5" containerName="postgres" containerID="cri-o://c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8" gracePeriod=30 Jul 21 18:49:29.741860 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:29.741835 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-kb8rh"] Jul 21 18:49:29.742025 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:29.742003 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" podUID="76edc020-7848-45a2-a1c1-b4f47f81f2c5" containerName="redis" containerID="cri-o://11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1" gracePeriod=30 Jul 21 18:49:29.808146 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:29.808116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:30.007913 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.007889 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:49:30.010833 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.010805 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:49:30.159654 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.159602 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knx6r\" (UniqueName: \"kubernetes.io/projected/76edc020-7848-45a2-a1c1-b4f47f81f2c5-kube-api-access-knx6r\") pod \"76edc020-7848-45a2-a1c1-b4f47f81f2c5\" (UID: \"76edc020-7848-45a2-a1c1-b4f47f81f2c5\") " Jul 21 18:49:30.159863 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.159668 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnp7k\" (UniqueName: \"kubernetes.io/projected/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-kube-api-access-gnp7k\") pod \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " Jul 21 18:49:30.159863 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.159746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-postgresdata\") pod \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\" (UID: \"10d1ffee-f72b-475f-bda1-2dcc30c49fd5\") " Jul 21 18:49:30.162074 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.162041 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76edc020-7848-45a2-a1c1-b4f47f81f2c5-kube-api-access-knx6r" (OuterVolumeSpecName: "kube-api-access-knx6r") pod "76edc020-7848-45a2-a1c1-b4f47f81f2c5" (UID: "76edc020-7848-45a2-a1c1-b4f47f81f2c5"). InnerVolumeSpecName "kube-api-access-knx6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:49:30.162204 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.162080 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-kube-api-access-gnp7k" (OuterVolumeSpecName: "kube-api-access-gnp7k") pod "10d1ffee-f72b-475f-bda1-2dcc30c49fd5" (UID: "10d1ffee-f72b-475f-bda1-2dcc30c49fd5"). InnerVolumeSpecName "kube-api-access-gnp7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:49:30.189894 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.189851 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "10d1ffee-f72b-475f-bda1-2dcc30c49fd5" (UID: "10d1ffee-f72b-475f-bda1-2dcc30c49fd5"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:49:30.261371 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.261330 2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-postgresdata\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:30.261371 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.261367 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knx6r\" (UniqueName: \"kubernetes.io/projected/76edc020-7848-45a2-a1c1-b4f47f81f2c5-kube-api-access-knx6r\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:30.261371 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.261378 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnp7k\" (UniqueName: \"kubernetes.io/projected/10d1ffee-f72b-475f-bda1-2dcc30c49fd5-kube-api-access-gnp7k\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:30.569132 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.569103 2565 generic.go:356] "Generic (PLEG): container finished" podID="76edc020-7848-45a2-a1c1-b4f47f81f2c5" containerID="11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1" exitCode=0 Jul 21 18:49:30.569277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.569141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" event={"ID":"76edc020-7848-45a2-a1c1-b4f47f81f2c5","Type":"ContainerDied","Data":"11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1"} Jul 21 18:49:30.569277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.569159 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" Jul 21 18:49:30.569277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.569189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-kb8rh" event={"ID":"76edc020-7848-45a2-a1c1-b4f47f81f2c5","Type":"ContainerDied","Data":"1d2298b6bbed5574fd69d4aa57c205047f1451c562c5fea3a18949a478133cba"} Jul 21 18:49:30.569277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.569212 2565 scope.go:117] "RemoveContainer" containerID="11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1" Jul 21 18:49:30.570842 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.570819 2565 generic.go:356] "Generic (PLEG): container finished" podID="10d1ffee-f72b-475f-bda1-2dcc30c49fd5" containerID="c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8" exitCode=0 Jul 21 18:49:30.571175 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.570863 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" Jul 21 18:49:30.571175 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.570925 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" event={"ID":"10d1ffee-f72b-475f-bda1-2dcc30c49fd5","Type":"ContainerDied","Data":"c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8"} Jul 21 18:49:30.571175 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.570951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-d222b" event={"ID":"10d1ffee-f72b-475f-bda1-2dcc30c49fd5","Type":"ContainerDied","Data":"6695789c6aa4f9cb80b122b9c9b16d982f4c64332ec5dcd35dd1359b7286ba9c"} Jul 21 18:49:30.578006 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.577987 2565 scope.go:117] "RemoveContainer" containerID="11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1" Jul 21 18:49:30.578310 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:49:30.578288 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1\": container with ID starting with 11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1 not found: ID does not exist" containerID="11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1" Jul 21 18:49:30.578406 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.578318 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1"} err="failed to get container status \"11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1\": rpc error: code = NotFound desc = could not find container \"11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1\": container with ID starting with 11fc58f110b3a048b60838171ead4335c52fb514759d2b356a4eb7a4435359a1 not found: ID does not exist" Jul 21 18:49:30.578406 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.578336 2565 scope.go:117] "RemoveContainer" containerID="c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8" Jul 21 18:49:30.586019 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.586000 2565 scope.go:117] "RemoveContainer" containerID="c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8" Jul 21 18:49:30.586396 ip-10-0-137-12 kubenswrapper[2565]: E0721 18:49:30.586366 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8\": container with ID starting with c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8 not found: ID does not exist" containerID="c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8" Jul 21 18:49:30.586516 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.586405 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8"} err="failed to get container status \"c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8\": rpc error: code = NotFound desc = could not find container \"c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8\": container with ID starting with c4bf1ead9de303dc83d1b410635fa8fca111ba9bd7d4ba8a5e1ed86d992455f8 not found: ID does not exist" Jul 21 18:49:30.587935 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.587911 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d222b"] Jul 21 18:49:30.592331 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.592310 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-d222b"] Jul 21 18:49:30.603502 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.603477 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-kb8rh"] Jul 21 18:49:30.607649 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:30.607628 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-kb8rh"] Jul 21 18:49:32.261145 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:32.261108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:32.333059 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:32.333029 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:32.557213 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:32.557119 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d1ffee-f72b-475f-bda1-2dcc30c49fd5" path="/var/lib/kubelet/pods/10d1ffee-f72b-475f-bda1-2dcc30c49fd5/volumes" Jul 21 18:49:32.557530 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:32.557511 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76edc020-7848-45a2-a1c1-b4f47f81f2c5" path="/var/lib/kubelet/pods/76edc020-7848-45a2-a1c1-b4f47f81f2c5/volumes" Jul 21 18:49:33.145680 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:33.145625 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Jul 21 18:49:33.780156 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:33.780075 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 21 18:49:37.535886 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:37.535808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:37.632994 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:37.632949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:38.172748 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:38.172713 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:43.145340 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:43.145293 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Jul 21 18:49:43.780545 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:43.780502 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 21 18:49:53.145376 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:53.145324 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused" Jul 21 18:49:53.145766 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:53.145459 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:49:53.780861 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:53.780807 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 21 18:49:53.781039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:53.780943 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:49:54.398739 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:54.398701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:54.497541 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:54.497504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:54.763621 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:54.763580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:54.864286 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:54.864251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:54.965621 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:54.965584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:55.033860 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:55.033761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:55.134813 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:55.134776 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:55.251867 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:55.251832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:49:57.687306 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:57.687216 2565 generic.go:356] "Generic (PLEG): container finished" podID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerID="d63c17d96245f8a2b0ac639f8d8272670e7cba075e3ca893531c75cd4afdaeb3" exitCode=137 Jul 21 18:49:57.687306 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:57.687286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerDied","Data":"d63c17d96245f8a2b0ac639f8d8272670e7cba075e3ca893531c75cd4afdaeb3"} Jul 21 18:49:57.689643 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:57.689619 2565 generic.go:356] "Generic (PLEG): container finished" podID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerID="8895f4c9512b8d1c39c83e785cc6daed94c2fe18efa9fcf0b4f6cecca923e56e" exitCode=137 Jul 21 18:49:57.689780 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:57.689690 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerDied","Data":"8895f4c9512b8d1c39c83e785cc6daed94c2fe18efa9fcf0b4f6cecca923e56e"} Jul 21 18:49:57.996424 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:57.996396 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:49:57.998781 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:57.998760 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:49:58.086990 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.086953 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls\") pod \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " Jul 21 18:49:58.086990 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.086993 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-online-tls\") pod \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " Jul 21 18:49:58.087280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.087030 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-feast-data\") pod \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " Jul 21 18:49:58.087280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.087061 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpbtf\" (UniqueName: \"kubernetes.io/projected/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-kube-api-access-wpbtf\") pod \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " Jul 21 18:49:58.087280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.087128 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-registry-tls\") pod \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " Jul 21 18:49:58.087280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.087160 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztbh8\" (UniqueName: \"kubernetes.io/projected/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-kube-api-access-ztbh8\") pod \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " Jul 21 18:49:58.087280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.087207 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-online-tls\") pod \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\" (UID: \"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c\") " Jul 21 18:49:58.087280 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.087235 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-feast-data\") pod \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\" (UID: \"6a5c793e-2f43-48bc-a0d2-dd89ebb01504\") " Jul 21 18:49:58.088112 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.088044 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-feast-data" (OuterVolumeSpecName: "feast-data") pod "6a5c793e-2f43-48bc-a0d2-dd89ebb01504" (UID: "6a5c793e-2f43-48bc-a0d2-dd89ebb01504"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:49:58.089596 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.089560 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-online-tls" (OuterVolumeSpecName: "online-tls") pod "6a5c793e-2f43-48bc-a0d2-dd89ebb01504" (UID: "6a5c793e-2f43-48bc-a0d2-dd89ebb01504"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:49:58.089739 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.089713 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" (UID: "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:49:58.090046 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.090017 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-kube-api-access-wpbtf" (OuterVolumeSpecName: "kube-api-access-wpbtf") pod "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" (UID: "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c"). InnerVolumeSpecName "kube-api-access-wpbtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:49:58.090179 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.090083 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6a5c793e-2f43-48bc-a0d2-dd89ebb01504" (UID: "6a5c793e-2f43-48bc-a0d2-dd89ebb01504"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:49:58.090179 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.090129 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-online-tls" (OuterVolumeSpecName: "online-tls") pod "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" (UID: "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 18:49:58.090303 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.090283 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-kube-api-access-ztbh8" (OuterVolumeSpecName: "kube-api-access-ztbh8") pod "6a5c793e-2f43-48bc-a0d2-dd89ebb01504" (UID: "6a5c793e-2f43-48bc-a0d2-dd89ebb01504"). InnerVolumeSpecName "kube-api-access-ztbh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 18:49:58.096834 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.096806 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-feast-data" (OuterVolumeSpecName: "feast-data") pod "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" (UID: "3b3739d9-510f-4e9f-9d3a-c95ab3381c6c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 18:49:58.187997 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.187957 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-online-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.187997 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.187989 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-feast-data\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.187997 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.187998 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpbtf\" (UniqueName: \"kubernetes.io/projected/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-kube-api-access-wpbtf\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.187997 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.188007 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.188306 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.188019 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztbh8\" (UniqueName: \"kubernetes.io/projected/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-kube-api-access-ztbh8\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.188306 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.188027 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c-online-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.188306 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.188035 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-feast-data\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.188306 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.188052 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5c793e-2f43-48bc-a0d2-dd89ebb01504-registry-tls\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 18:49:58.695716 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.695629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" event={"ID":"3b3739d9-510f-4e9f-9d3a-c95ab3381c6c","Type":"ContainerDied","Data":"58fef2f11a524af6699e9e0242ba5008a54ff3fb6752ac56662ba6bf240514f5"} Jul 21 18:49:58.695716 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.695644 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5" Jul 21 18:49:58.695716 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.695691 2565 scope.go:117] "RemoveContainer" containerID="bc6fc4fee974c3e76d1dab079e48b8862f311c77bbfbf703f5e50d461b0edeeb" Jul 21 18:49:58.704245 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.704213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" event={"ID":"6a5c793e-2f43-48bc-a0d2-dd89ebb01504","Type":"ContainerDied","Data":"116fc1a6da4382a2e0c7c74cc1abf9dce81087b261d39df9667533793ec709de"} Jul 21 18:49:58.704384 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.704259 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp" Jul 21 18:49:58.710403 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.710380 2565 scope.go:117] "RemoveContainer" containerID="d63c17d96245f8a2b0ac639f8d8272670e7cba075e3ca893531c75cd4afdaeb3" Jul 21 18:49:58.717309 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.717286 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5"] Jul 21 18:49:58.718808 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.718791 2565 scope.go:117] "RemoveContainer" containerID="553ca1d629ab796d03dad12b93817b64318778165a73c0d5c440c1516d8f3413" Jul 21 18:49:58.721621 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.721601 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6ffc5c5d49-wstk5"] Jul 21 18:49:58.726972 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.726955 2565 scope.go:117] "RemoveContainer" containerID="c634e95f333a5404d4fcc5e59226c7d391f036cf5d2e29e1969652cff71f4e65" Jul 21 18:49:58.733005 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.732978 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp"] Jul 21 18:49:58.735724 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.735696 2565 scope.go:117] "RemoveContainer" containerID="974f3c1a5ddd6179fedc9e73d5f86c057d671f6e1bf72ed8535d482be6604db1" Jul 21 18:49:58.735826 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.735764 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-67c5b9fbdb-bhxdp"] Jul 21 18:49:58.743792 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.743774 2565 scope.go:117] "RemoveContainer" containerID="8895f4c9512b8d1c39c83e785cc6daed94c2fe18efa9fcf0b4f6cecca923e56e" Jul 21 18:49:58.752065 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.752046 2565 scope.go:117] "RemoveContainer" containerID="40adf5bc745672deb10e6da47c289c53c8f875a6f7fe28777f8bd7852a6f459d" Jul 21 18:49:58.759899 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:49:58.759879 2565 scope.go:117] "RemoveContainer" containerID="5b1923b4fb9b5f23f84de53108f74319ecf67cf81d8a1f338147a443f1d5d13e" Jul 21 18:50:00.558055 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:00.558012 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" path="/var/lib/kubelet/pods/3b3739d9-510f-4e9f-9d3a-c95ab3381c6c/volumes" Jul 21 18:50:00.558572 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:00.558557 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" path="/var/lib/kubelet/pods/6a5c793e-2f43-48bc-a0d2-dd89ebb01504/volumes" Jul 21 18:50:07.358040 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:07.358007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:50:09.457113 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:09.457054 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:50:14.507778 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:14.507747 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:50:14.509294 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:14.509257 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:50:14.512482 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:14.512457 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:50:14.514002 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:50:14.513984 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:51:24.323452 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:24.323417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.265314 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.265278 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.323797 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.323752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.445250 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.445219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.548579 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.548458 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.613026 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.612982 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.686188 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.686160 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:51:34.753014 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:51:34.752980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.017319 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.017227 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.111509 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.111476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.279162 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.279031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.360452 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.360415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.417756 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.417711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.579602 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.579497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:52:58.678819 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:52:58.678789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:54:23.830519 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:54:23.830487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:54:23.918417 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:54:23.918387 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:54:24.017973 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:54:24.017938 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:54:24.142980 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:54:24.142885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:54:29.094685 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:54:29.094648 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:07.399799 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:07.399768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:07.457707 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:07.457673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:12.392313 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:12.392264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:13.453001 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:13.452965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:14.531522 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:14.531497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:55:14.533305 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:14.533283 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 18:55:14.535349 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:14.535327 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:55:14.537346 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:14.537328 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 18:55:31.509589 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:31.509547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:31.611114 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:31.611057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:35.152899 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:35.152851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:35.253905 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:35.253864 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:35.352290 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:35.352251 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:35.481148 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:35.481023 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:35.580380 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:35.580304 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:35.638312 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:35.638283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:55:47.084976 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:55:47.084946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.315039 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.315005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.378183 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.378147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.501341 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.501301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.596925 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.596834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.682334 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.682298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.784013 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.783973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:56:59.883555 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:56:59.883469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:57:13.965121 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:57:13.965066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:57:18.239105 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:57:18.239064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:20.736656 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:20.736625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:20.794545 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:20.794511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:20.945801 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:20.945763 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:21.047053 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:21.047015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:21.126948 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:21.126911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:21.187995 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:21.187951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:21.445064 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:21.444972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:58:31.322565 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:58:31.322530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:59:42.183326 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:59:42.183297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:59:42.241619 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:59:42.241593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:59:42.332356 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:59:42.332321 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:59:42.444277 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:59:42.444191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:59:42.545238 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:59:42.545209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 18:59:47.508043 ip-10-0-137-12 kubenswrapper[2565]: I0721 18:59:47.508008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:14.554073 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:14.554043 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 19:00:14.557338 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:14.557315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 19:00:14.558898 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:14.558876 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 19:00:14.561593 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:14.561564 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 19:00:26.233333 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:26.233294 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:29.784990 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:29.784956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:30.880814 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:30.880774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:30.984827 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:30.984794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:32.018235 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7mvj/must-gather-tvls6"] Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018476 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="feast-apply" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018487 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="feast-apply" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018496 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018503 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018513 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76edc020-7848-45a2-a1c1-b4f47f81f2c5" containerName="redis" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018518 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="76edc020-7848-45a2-a1c1-b4f47f81f2c5" containerName="redis" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018524 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="feast-init" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018529 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="feast-init" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018537 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018542 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018549 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018554 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018559 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018563 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018570 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d1ffee-f72b-475f-bda1-2dcc30c49fd5" containerName="postgres" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018575 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d1ffee-f72b-475f-bda1-2dcc30c49fd5" containerName="postgres" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018585 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="feast-init" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018590 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="feast-init" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018596 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65d8bb34-bbae-4d71-b6c7-4914e44a9e93" containerName="manager" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018602 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65d8bb34-bbae-4d71-b6c7-4914e44a9e93" containerName="manager" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018608 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="feast-apply" Jul 21 19:00:32.018643 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018612 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="feast-apply" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018656 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d1ffee-f72b-475f-bda1-2dcc30c49fd5" containerName="postgres" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018665 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="registry" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018670 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5c793e-2f43-48bc-a0d2-dd89ebb01504" containerName="online" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018676 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="online" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018682 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65d8bb34-bbae-4d71-b6c7-4914e44a9e93" containerName="manager" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018687 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="76edc020-7848-45a2-a1c1-b4f47f81f2c5" containerName="redis" Jul 21 19:00:32.019331 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.018693 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b3739d9-510f-4e9f-9d3a-c95ab3381c6c" containerName="registry" Jul 21 19:00:32.021589 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.021572 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.023443 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.023406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:32.024738 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.024718 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7mvj\"/\"kube-root-ca.crt\"" Jul 21 19:00:32.024738 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.024731 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7mvj\"/\"openshift-service-ca.crt\"" Jul 21 19:00:32.024910 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.024725 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7mvj\"/\"default-dockercfg-mhhwg\"" Jul 21 19:00:32.030056 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.030034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7mvj/must-gather-tvls6"] Jul 21 19:00:32.084632 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.084600 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:32.200424 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.200388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-must-gather-output\") pod \"must-gather-tvls6\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.200630 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.200454 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncnkq\" (UniqueName: \"kubernetes.io/projected/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-kube-api-access-ncnkq\") pod \"must-gather-tvls6\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.301065 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.300965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-must-gather-output\") pod \"must-gather-tvls6\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.301065 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.301016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncnkq\" (UniqueName: \"kubernetes.io/projected/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-kube-api-access-ncnkq\") pod \"must-gather-tvls6\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.301432 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.301408 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-must-gather-output\") pod \"must-gather-tvls6\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.310882 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.310853 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncnkq\" (UniqueName: \"kubernetes.io/projected/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-kube-api-access-ncnkq\") pod \"must-gather-tvls6\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.346955 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.346906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:32.484306 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.484168 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7mvj/must-gather-tvls6"] Jul 21 19:00:32.486978 ip-10-0-137-12 kubenswrapper[2565]: W0721 19:00:32.486951 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b9bcc75_d96b_42fd_9662_41b8e8a0e28c.slice/crio-41683985c735fd6691e84036b3d8289d5fc597fb55b6a7839cef1dd3fff9f17c WatchSource:0}: Error finding container 41683985c735fd6691e84036b3d8289d5fc597fb55b6a7839cef1dd3fff9f17c: Status 404 returned error can't find the container with id 41683985c735fd6691e84036b3d8289d5fc597fb55b6a7839cef1dd3fff9f17c Jul 21 19:00:32.488826 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:32.488812 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 19:00:33.071450 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:33.071408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7mvj/must-gather-tvls6" event={"ID":"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c","Type":"ContainerStarted","Data":"41683985c735fd6691e84036b3d8289d5fc597fb55b6a7839cef1dd3fff9f17c"} Jul 21 19:00:39.101751 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:39.101687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7mvj/must-gather-tvls6" event={"ID":"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c","Type":"ContainerStarted","Data":"0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6"} Jul 21 19:00:40.113601 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:40.113558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7mvj/must-gather-tvls6" event={"ID":"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c","Type":"ContainerStarted","Data":"f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8"} Jul 21 19:00:40.133379 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:40.133314 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7mvj/must-gather-tvls6" podStartSLOduration=2.780716482 podStartE2EDuration="9.133293086s" totalImagesPullingTime="6.352576604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 19:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:00:40.131396624 +0000 UTC m=+1826.065035021" watchObservedRunningTime="2026-07-21 19:00:40.133293086 +0000 UTC m=+1826.066931481" Jul 21 19:00:49.149667 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:49.149581 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerID="0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6" exitCode=0 Jul 21 19:00:49.149667 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:49.149653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7mvj/must-gather-tvls6" event={"ID":"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c","Type":"ContainerDied","Data":"0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6"} Jul 21 19:00:49.150126 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:49.150005 2565 scope.go:117] "RemoveContainer" containerID="0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6" Jul 21 19:00:49.841031 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:49.841002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-c7mvj_must-gather-tvls6_2b9bcc75-d96b-42fd-9662-41b8e8a0e28c/gather/0.log" Jul 21 19:00:50.202214 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:50.202139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:50.382195 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:50.382163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:50.487415 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:50.487331 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:53.038934 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:53.038903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6d7dw_781c4cdf-7ae7-4a7b-9cc8-efa29a22b3ad/global-pull-secret-syncer/0.log" Jul 21 19:00:53.209504 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:53.209475 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" Jul 21 19:00:53.339208 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:53.339116 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-12.ec2.internal_f4f721e547e13bf17c3613886dc1af5b/haproxy/0.log" Jul 21 19:00:55.174888 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.174852 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-c7mvj/must-gather-tvls6"] Jul 21 19:00:55.175712 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.175679 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-c7mvj/must-gather-tvls6" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="copy" containerID="cri-o://f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8" gracePeriod=2 Jul 21 19:00:55.178840 ip-10-0-137-12 kubenswrapper[2565]: E0721 19:00:55.178795 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tvls6\" is forbidden: User \"system:node:ip-10-0-137-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-c7mvj\": no relationship found between node 'ip-10-0-137-12.ec2.internal' and this object" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:55.181435 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.181408 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-c7mvj/must-gather-tvls6"] Jul 21 19:00:55.416249 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.416224 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-c7mvj_must-gather-tvls6_2b9bcc75-d96b-42fd-9662-41b8e8a0e28c/copy/0.log" Jul 21 19:00:55.418721 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.418703 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:55.420749 ip-10-0-137-12 kubenswrapper[2565]: E0721 19:00:55.420724 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tvls6\" is forbidden: User \"system:node:ip-10-0-137-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-c7mvj\": no relationship found between node 'ip-10-0-137-12.ec2.internal' and this object" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:55.491403 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.491322 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncnkq\" (UniqueName: \"kubernetes.io/projected/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-kube-api-access-ncnkq\") pod \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " Jul 21 19:00:55.491403 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.491372 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-must-gather-output\") pod \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\" (UID: \"2b9bcc75-d96b-42fd-9662-41b8e8a0e28c\") " Jul 21 19:00:55.491796 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.491768 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" (UID: "2b9bcc75-d96b-42fd-9662-41b8e8a0e28c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 19:00:55.493750 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.493725 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-kube-api-access-ncnkq" (OuterVolumeSpecName: "kube-api-access-ncnkq") pod "2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" (UID: "2b9bcc75-d96b-42fd-9662-41b8e8a0e28c"). InnerVolumeSpecName "kube-api-access-ncnkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 19:00:55.592379 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.592337 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncnkq\" (UniqueName: \"kubernetes.io/projected/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-kube-api-access-ncnkq\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 19:00:55.592379 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.592367 2565 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c-must-gather-output\") on node \"ip-10-0-137-12.ec2.internal\" DevicePath \"\"" Jul 21 19:00:55.873389 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.873359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:55.973010 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:55.972980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9qdx6_8adeed6a-2187-4327-a504-413c342e1ea6/konnectivity-agent/0.log" limit=1024 Jul 21 19:00:56.179833 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.179810 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-c7mvj_must-gather-tvls6_2b9bcc75-d96b-42fd-9662-41b8e8a0e28c/copy/0.log" Jul 21 19:00:56.180227 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.180174 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerID="f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8" exitCode=143 Jul 21 19:00:56.180269 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.180227 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:56.180304 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.180284 2565 scope.go:117] "RemoveContainer" containerID="f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8" Jul 21 19:00:56.182707 ip-10-0-137-12 kubenswrapper[2565]: E0721 19:00:56.182681 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tvls6\" is forbidden: User \"system:node:ip-10-0-137-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-c7mvj\": no relationship found between node 'ip-10-0-137-12.ec2.internal' and this object" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:56.188455 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.188437 2565 scope.go:117] "RemoveContainer" containerID="0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6" Jul 21 19:00:56.190873 ip-10-0-137-12 kubenswrapper[2565]: E0721 19:00:56.190851 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-tvls6\" is forbidden: User \"system:node:ip-10-0-137-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-c7mvj\": no relationship found between node 'ip-10-0-137-12.ec2.internal' and this object" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" pod="openshift-must-gather-c7mvj/must-gather-tvls6" Jul 21 19:00:56.199592 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.199572 2565 scope.go:117] "RemoveContainer" containerID="f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8" Jul 21 19:00:56.199867 ip-10-0-137-12 kubenswrapper[2565]: E0721 19:00:56.199849 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8\": container with ID starting with f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8 not found: ID does not exist" containerID="f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8" Jul 21 19:00:56.199941 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.199882 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8"} err="failed to get container status \"f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8\": rpc error: code = NotFound desc = could not find container \"f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8\": container with ID starting with f6b08ca9e09cefa9939feb233cabebbc5e92899583fa69327324d147f1bd23b8 not found: ID does not exist" Jul 21 19:00:56.199941 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.199907 2565 scope.go:117] "RemoveContainer" containerID="0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6" Jul 21 19:00:56.200284 ip-10-0-137-12 kubenswrapper[2565]: E0721 19:00:56.200260 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6\": container with ID starting with 0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6 not found: ID does not exist" containerID="0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6" Jul 21 19:00:56.200388 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.200289 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6"} err="failed to get container status \"0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6\": rpc error: code = NotFound desc = could not find container \"0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6\": container with ID starting with 0aebb1b6886600fdb509d9e91e63669870b98be7360cb503941243c4acaf8dc6 not found: ID does not exist" Jul 21 19:00:56.556882 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:56.556848 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" path="/var/lib/kubelet/pods/2b9bcc75-d96b-42fd-9662-41b8e8a0e28c/volumes" Jul 21 19:00:57.195832 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:57.195798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-pqsd4_ecd290ce-81cb-4e9b-8f87-1adb3f55df0e/cluster-monitoring-operator/0.log" Jul 21 19:00:57.366647 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:57.366621 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4sqlr_51cc8e44-238e-4d89-a4f0-46771a9bbca8/node-exporter/0.log" Jul 21 19:00:57.393256 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:57.393231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4sqlr_51cc8e44-238e-4d89-a4f0-46771a9bbca8/kube-rbac-proxy/0.log" Jul 21 19:00:57.416456 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:57.416429 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4sqlr_51cc8e44-238e-4d89-a4f0-46771a9bbca8/init-textfile/0.log" Jul 21 19:00:57.883028 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:57.883000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-5qjrv_60d46f8a-f9b9-448b-8082-3d4197de05a8/prometheus-operator-admission-webhook/0.log" Jul 21 19:00:59.342767 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:59.342741 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-v729j_5f0ed91a-e26b-4baa-ac66-6024848db838/networking-console-plugin/0.log" Jul 21 19:00:59.786819 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:59.786796 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/1.log" Jul 21 19:00:59.791841 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:00:59.791820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-hgfk5_4247d7cb-61b6-44e1-afa6-57876b5e44a6/console-operator/2.log" Jul 21 19:01:00.167676 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.167594 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-fqvg4_de20c2bf-713c-4490-bad9-8b4e9a094b61/download-server/0.log" Jul 21 19:01:00.491928 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.491839 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm"] Jul 21 19:01:00.492415 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.492261 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="copy" Jul 21 19:01:00.492415 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.492278 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="copy" Jul 21 19:01:00.492415 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.492301 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="gather" Jul 21 19:01:00.492415 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.492309 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="gather" Jul 21 19:01:00.492621 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.492425 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="gather" Jul 21 19:01:00.492621 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.492436 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b9bcc75-d96b-42fd-9662-41b8e8a0e28c" containerName="copy" Jul 21 19:01:00.498043 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.498013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.500855 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.500825 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbltb\"/\"kube-root-ca.crt\"" Jul 21 19:01:00.502523 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.502469 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbltb\"/\"openshift-service-ca.crt\"" Jul 21 19:01:00.502714 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.502609 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gbltb\"/\"default-dockercfg-mfx8k\"" Jul 21 19:01:00.504156 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.504128 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm"] Jul 21 19:01:00.531908 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.531861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-lib-modules\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.531908 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.531918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-podres\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.532185 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.531981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-sys\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.532185 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.532008 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmffj\" (UniqueName: \"kubernetes.io/projected/8dd20235-f893-443b-8b3c-c835aba18c24-kube-api-access-gmffj\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.532185 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.532035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-proc\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.632905 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.632860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-podres\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.632923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-sys\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.632954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmffj\" (UniqueName: \"kubernetes.io/projected/8dd20235-f893-443b-8b3c-c835aba18c24-kube-api-access-gmffj\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.632987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-proc\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.633006 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-sys\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.633019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-lib-modules\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.633042 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-podres\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633147 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.633121 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-proc\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.633414 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.633174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dd20235-f893-443b-8b3c-c835aba18c24-lib-modules\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.641268 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.641245 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmffj\" (UniqueName: \"kubernetes.io/projected/8dd20235-f893-443b-8b3c-c835aba18c24-kube-api-access-gmffj\") pod \"perf-node-gather-daemonset-rn5gm\" (UID: \"8dd20235-f893-443b-8b3c-c835aba18c24\") " pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.676537 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.676506 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-lpzvp_e5b91385-4133-4ee3-a2f6-71fd7f6d4eed/volume-data-source-validator/0.log" Jul 21 19:01:00.809608 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.809571 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:00.942843 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:00.942819 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm"] Jul 21 19:01:00.945523 ip-10-0-137-12 kubenswrapper[2565]: W0721 19:01:00.945491 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8dd20235_f893_443b_8b3c_c835aba18c24.slice/crio-3a7d4c9afcc94f7fb3891e06721b00f8690e43b752f6454a092a5650ce041af3 WatchSource:0}: Error finding container 3a7d4c9afcc94f7fb3891e06721b00f8690e43b752f6454a092a5650ce041af3: Status 404 returned error can't find the container with id 3a7d4c9afcc94f7fb3891e06721b00f8690e43b752f6454a092a5650ce041af3 Jul 21 19:01:01.203434 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.203336 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" event={"ID":"8dd20235-f893-443b-8b3c-c835aba18c24","Type":"ContainerStarted","Data":"3fecfb8e199d7270fb52da80469ba3b5efab7e5b043ffac9eccee4dc44bbc2a2"} Jul 21 19:01:01.203434 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.203392 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" event={"ID":"8dd20235-f893-443b-8b3c-c835aba18c24","Type":"ContainerStarted","Data":"3a7d4c9afcc94f7fb3891e06721b00f8690e43b752f6454a092a5650ce041af3"} Jul 21 19:01:01.203622 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.203436 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:01.240813 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.240757 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" podStartSLOduration=1.240740616 podStartE2EDuration="1.240740616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 19:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 19:01:01.240510573 +0000 UTC m=+1847.174148966" watchObservedRunningTime="2026-07-21 19:01:01.240740616 +0000 UTC m=+1847.174379010" Jul 21 19:01:01.492359 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.492251 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9hkz5_9742bb19-be0c-41fe-8ea6-e4af1161ba5c/dns/0.log" Jul 21 19:01:01.512266 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.512203 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9hkz5_9742bb19-be0c-41fe-8ea6-e4af1161ba5c/kube-rbac-proxy/0.log" Jul 21 19:01:01.681437 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:01.681402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd2z9_f86889d0-703b-43e8-b66e-5fe7a3632535/dns-node-resolver/0.log" Jul 21 19:01:02.163891 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:02.163852 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dm9tm_95748c1a-496b-46c0-9d7f-eac96cafda55/node-ca/0.log" Jul 21 19:01:02.901253 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:02.901227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67c9769c8d-svp7r_92b73819-48f9-42a1-817a-813c899b1853/router/0.log" Jul 21 19:01:03.306133 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:03.306082 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n54cs_2387f71e-ff4d-459c-a1f9-ca28a78e1800/serve-healthcheck-canary/0.log" Jul 21 19:01:03.667882 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:03.667759 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xl85l_c3180351-57cd-4a37-a9e8-f9c4b01dde1b/insights-operator/0.log" Jul 21 19:01:03.668531 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:03.668515 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xl85l_c3180351-57cd-4a37-a9e8-f9c4b01dde1b/insights-operator/1.log" Jul 21 19:01:03.844140 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:03.844109 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvv2l_853c902a-f290-432c-a097-4233d9340ad0/kube-rbac-proxy/0.log" Jul 21 19:01:03.868337 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:03.868312 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvv2l_853c902a-f290-432c-a097-4233d9340ad0/exporter/0.log" Jul 21 19:01:03.898608 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:03.898578 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xvv2l_853c902a-f290-432c-a097-4233d9340ad0/extractor/0.log" Jul 21 19:01:07.218263 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:07.218234 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gbltb/perf-node-gather-daemonset-rn5gm" Jul 21 19:01:08.153210 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:08.153180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-2vgt6_199b7b74-a0bd-48b3-9373-65b8d7e2733f/migrator/0.log" Jul 21 19:01:08.177016 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:08.176983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-2vgt6_199b7b74-a0bd-48b3-9373-65b8d7e2733f/graceful-termination/0.log" Jul 21 19:01:08.482767 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:08.482664 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-kxkj4_2c110131-b834-4e7d-abb0-c044b1d1fa0f/kube-storage-version-migrator-operator/1.log" Jul 21 19:01:08.484865 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:08.484837 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-kxkj4_2c110131-b834-4e7d-abb0-c044b1d1fa0f/kube-storage-version-migrator-operator/0.log" Jul 21 19:01:09.496479 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.496453 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/kube-multus-additional-cni-plugins/0.log" Jul 21 19:01:09.519244 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.519214 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/egress-router-binary-copy/0.log" Jul 21 19:01:09.543291 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.543269 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/cni-plugins/0.log" Jul 21 19:01:09.572444 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.572412 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/bond-cni-plugin/0.log" Jul 21 19:01:09.612560 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.612533 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/routeoverride-cni/0.log" Jul 21 19:01:09.634479 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.634447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/whereabouts-cni-bincopy/0.log" Jul 21 19:01:09.657513 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:09.657489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps6j_63b6f525-5045-42af-bba6-e33a7ab072b1/whereabouts-cni/0.log" Jul 21 19:01:10.107816 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:10.107789 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dxr8r_a417814d-d92e-4dd2-92a6-8d311ee9542a/kube-multus/0.log" Jul 21 19:01:10.233277 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:10.233200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zfx75_25cd6f50-f464-49ae-a833-6eafeb473291/network-metrics-daemon/0.log" Jul 21 19:01:10.251539 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:10.251509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zfx75_25cd6f50-f464-49ae-a833-6eafeb473291/kube-rbac-proxy/0.log" Jul 21 19:01:11.478809 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.478778 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-controller/0.log" Jul 21 19:01:11.495944 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.495913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/0.log" Jul 21 19:01:11.495944 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.495915 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovn-acl-logging/1.log" Jul 21 19:01:11.511217 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.511190 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/kube-rbac-proxy-node/0.log" Jul 21 19:01:11.529533 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.529433 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 19:01:11.546988 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.546947 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/northd/0.log" Jul 21 19:01:11.566742 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.566717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/nbdb/0.log" Jul 21 19:01:11.585436 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.585415 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/sbdb/0.log" Jul 21 19:01:11.630146 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:11.630119 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mcnjr_342dd22f-6aa0-442e-b0f6-291a497a49ae/ovnkube-controller/0.log" Jul 21 19:01:12.522062 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:12.522033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-6psgp_418fa088-8dc7-49be-af50-5dae49b6dad6/check-endpoints/0.log" Jul 21 19:01:12.542156 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:12.542128 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2656j_acf3797e-b0ff-4e5a-b0f8-eca8ba970770/network-check-target-container/0.log" Jul 21 19:01:13.468671 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:13.468648 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jcmsn_75b18d4d-7ac4-4f5f-8e3e-f2a8d4ec3b79/iptables-alerter/0.log" Jul 21 19:01:14.079337 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:14.079296 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8kbkt_37763de9-2cdc-4747-97ab-97c4e02e0dd3/tuned/0.log" Jul 21 19:01:15.610198 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:15.610163 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-4tskk_55118b09-cb92-4ba4-a0fd-3a1c350fe03a/cluster-samples-operator/0.log" Jul 21 19:01:15.625726 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:15.625698 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-79b7c55f87-4tskk_55118b09-cb92-4ba4-a0fd-3a1c350fe03a/cluster-samples-operator-watch/0.log" Jul 21 19:01:16.473606 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:16.473573 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-6ttsz_4527c326-62ce-4224-94e6-f4f8f85be296/service-ca-operator/1.log" Jul 21 19:01:16.474449 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:16.474430 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5bcbc94c78-6ttsz_4527c326-62ce-4224-94e6-f4f8f85be296/service-ca-operator/0.log" Jul 21 19:01:16.771762 ip-10-0-137-12 kubenswrapper[2565]: I0721 19:01:16.771733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-58598695f7-9pg5k_1269183b-6f36-4760-bf4e-2aa00c511a11/service-ca-controller/0.log"