Sep 08 10:17:14.004439 ip-10-0-134-85 systemd[1]: Starting Kubernetes Kubelet... Sep 08 10:17:14.446768 ip-10-0-134-85 kubenswrapper[2532]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:17:14.446768 ip-10-0-134-85 kubenswrapper[2532]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 10:17:14.446768 ip-10-0-134-85 kubenswrapper[2532]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:17:14.446768 ip-10-0-134-85 kubenswrapper[2532]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 10:17:14.446768 ip-10-0-134-85 kubenswrapper[2532]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 10:17:14.447468 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.446761 2532 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 10:17:14.450949 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450932 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:17:14.450949 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450948 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450953 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450957 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450960 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450963 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450966 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450968 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450971 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450974 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450977 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450979 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450982 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450985 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450988 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450990 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450993 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.450997 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451000 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451004 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451006 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:17:14.451013 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451009 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451011 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451014 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451017 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451019 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451022 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451025 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451027 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451030 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451032 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451035 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451037 2532 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451040 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451042 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451045 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451047 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451049 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451052 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451054 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451057 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:17:14.451560 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451059 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451062 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451064 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451068 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451070 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451074 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451078 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451081 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451083 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451085 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451088 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451091 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451093 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451096 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451100 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451102 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451105 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451108 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451110 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451113 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:17:14.452040 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451115 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451118 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451120 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451125 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451129 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451146 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451150 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451152 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451155 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451159 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451161 2532 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451164 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451167 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451169 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451172 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451175 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451178 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451181 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451184 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:17:14.452542 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451187 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451190 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451194 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451196 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451199 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451201 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451204 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451207 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451210 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451213 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451215 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451218 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451220 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451223 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451225 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451228 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451230 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451233 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451235 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:17:14.453001 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451934 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451941 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451945 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451950 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451954 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451957 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451960 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451963 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451966 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451969 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451972 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451975 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451979 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451981 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451984 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451986 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451989 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451992 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451994 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:17:14.453462 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.451997 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452000 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452003 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452005 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452008 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452012 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452015 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452017 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452020 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452022 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452025 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452028 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452030 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452033 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452035 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452038 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452041 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452043 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452046 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452049 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:17:14.453972 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452051 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452054 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452057 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452059 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452062 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452065 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452068 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452072 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452075 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452078 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452080 2532 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452084 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452086 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452089 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452092 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452095 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452097 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452100 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452102 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452105 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:17:14.454561 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452107 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452110 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452112 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452115 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452117 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452120 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452122 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452125 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452127 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452130 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452149 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452153 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452155 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452158 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452160 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452163 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452166 2532 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452169 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452172 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452175 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:17:14.455046 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452178 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452180 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452183 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452185 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452188 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452191 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452194 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452197 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452199 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452202 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452205 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452207 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452210 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452212 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452216 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452219 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452222 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452225 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452228 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:17:14.455571 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452231 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452616 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452622 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452625 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452628 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452630 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452633 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452636 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452638 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452641 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452646 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452649 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452652 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452655 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452658 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452662 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452666 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452669 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452672 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:17:14.456028 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452675 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452678 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452680 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452683 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452685 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452688 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452691 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452693 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452696 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452698 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452701 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452704 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452706 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452709 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452712 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452714 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452717 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452719 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452722 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452724 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:17:14.456511 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452727 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452730 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452732 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452736 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452739 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452742 2532 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452744 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452747 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452750 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452752 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452755 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452758 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452760 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452763 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452765 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452768 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452771 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452773 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452776 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452778 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:17:14.457011 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452781 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452784 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452786 2532 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452789 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452792 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452794 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452797 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452799 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452802 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452804 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452807 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452810 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452814 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452817 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452819 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452823 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452826 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452829 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452831 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:17:14.457509 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452834 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452837 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452839 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452842 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452844 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452847 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452849 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452852 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452854 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452857 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452859 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452862 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452864 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452867 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452869 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452872 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452874 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452877 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452880 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:17:14.457973 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452884 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452888 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.452891 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.452972 2532 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453020 2532 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453027 2532 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453032 2532 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453037 2532 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453040 2532 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453045 2532 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453050 2532 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453053 2532 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453056 2532 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453061 2532 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453064 2532 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453067 2532 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453070 2532 flags.go:64] FLAG: --cgroup-root="" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453073 2532 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453077 2532 flags.go:64] FLAG: --client-ca-file="" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453080 2532 flags.go:64] FLAG: --cloud-provider="external" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453083 2532 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453087 2532 flags.go:64] FLAG: --cluster-domain="" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453090 2532 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453093 2532 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 10:17:14.458442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453096 2532 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453100 2532 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453103 2532 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453106 2532 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453109 2532 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453113 2532 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453115 2532 flags.go:64] FLAG: --contention-profiling="false" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453119 2532 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453123 2532 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453126 2532 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453129 2532 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453147 2532 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453150 2532 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453153 2532 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453156 2532 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453159 2532 flags.go:64] FLAG: --enable-server="true" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453162 2532 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453168 2532 flags.go:64] FLAG: --event-burst="100" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453171 2532 flags.go:64] FLAG: --event-qps="50" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453174 2532 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453177 2532 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453180 2532 flags.go:64] FLAG: --eviction-hard="" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453184 2532 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453187 2532 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453190 2532 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 10:17:14.459011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453193 2532 flags.go:64] FLAG: --eviction-soft="" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453196 2532 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453199 2532 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453202 2532 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453204 2532 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453207 2532 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453210 2532 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453213 2532 flags.go:64] FLAG: --feature-gates="" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453217 2532 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453220 2532 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453223 2532 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453227 2532 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453229 2532 flags.go:64] FLAG: --healthz-port="10248" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453232 2532 flags.go:64] FLAG: --help="false" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453235 2532 flags.go:64] FLAG: --hostname-override="ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453240 2532 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453243 2532 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453246 2532 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453249 2532 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453252 2532 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453255 2532 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453258 2532 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453260 2532 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 10:17:14.459663 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453264 2532 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453267 2532 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453270 2532 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453273 2532 flags.go:64] FLAG: --kube-reserved="" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453276 2532 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453279 2532 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453282 2532 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453285 2532 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453288 2532 flags.go:64] FLAG: --lock-file="" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453291 2532 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453293 2532 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453297 2532 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453302 2532 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453304 2532 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453307 2532 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453309 2532 flags.go:64] FLAG: --logging-format="text" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453312 2532 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453316 2532 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453319 2532 flags.go:64] FLAG: --manifest-url="" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453321 2532 flags.go:64] FLAG: --manifest-url-header="" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453325 2532 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453328 2532 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453332 2532 flags.go:64] FLAG: --max-pods="110" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453335 2532 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453339 2532 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 10:17:14.460259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453342 2532 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453345 2532 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453348 2532 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453351 2532 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453354 2532 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453364 2532 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453367 2532 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453370 2532 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453375 2532 flags.go:64] FLAG: --pod-cidr="" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453377 2532 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453383 2532 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453386 2532 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453389 2532 flags.go:64] FLAG: --pods-per-core="0" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453392 2532 flags.go:64] FLAG: --port="10250" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453394 2532 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453398 2532 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f4dcb5e42be738fd" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453401 2532 flags.go:64] FLAG: --qos-reserved="" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453404 2532 flags.go:64] FLAG: --read-only-port="10255" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453407 2532 flags.go:64] FLAG: --register-node="true" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453410 2532 flags.go:64] FLAG: --register-with-taints="" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453413 2532 flags.go:64] FLAG: --registry-burst="10" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453416 2532 flags.go:64] FLAG: --registry-qps="5" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453418 2532 flags.go:64] FLAG: --reserved-cpus="" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453422 2532 flags.go:64] FLAG: --reserved-memory="" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453425 2532 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 10:17:14.461078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453428 2532 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453431 2532 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453434 2532 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453437 2532 flags.go:64] FLAG: --runonce="false" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453440 2532 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453442 2532 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453447 2532 flags.go:64] FLAG: --seccomp-default="false" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453450 2532 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453453 2532 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453456 2532 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453459 2532 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453462 2532 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453465 2532 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453468 2532 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453471 2532 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453474 2532 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453477 2532 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453480 2532 flags.go:64] FLAG: --system-cgroups="" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453483 2532 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453488 2532 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453491 2532 flags.go:64] FLAG: --tls-cert-file="" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453494 2532 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453498 2532 flags.go:64] FLAG: --tls-min-version="" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453501 2532 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453504 2532 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 10:17:14.462059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453506 2532 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453509 2532 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453512 2532 flags.go:64] FLAG: --v="2" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453516 2532 flags.go:64] FLAG: --version="false" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453520 2532 flags.go:64] FLAG: --vmodule="" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453523 2532 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453527 2532 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453676 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453682 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453685 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453688 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453691 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453694 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453698 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453701 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453704 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453707 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453710 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453713 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453715 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453718 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:17:14.462969 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453721 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453724 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453727 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453730 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453733 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453735 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453738 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453741 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453744 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453746 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453750 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453753 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453756 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453758 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453761 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453763 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453766 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453769 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453771 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453773 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:17:14.463552 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453776 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453778 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453781 2532 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453784 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453787 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453790 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453792 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453795 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453799 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453801 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453804 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453806 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453809 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453811 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453814 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453816 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453819 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453822 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453824 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453827 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:17:14.464081 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453829 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453832 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453834 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453837 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453840 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453842 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453845 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453847 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453850 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453852 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453855 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453857 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453860 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453862 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453865 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453867 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453871 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453873 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453876 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453878 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:17:14.464607 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453880 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453883 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453885 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453888 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453890 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453893 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453895 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453898 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453901 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453903 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453906 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453908 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453912 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453916 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453918 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453921 2532 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453925 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453928 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453931 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:17:14.465099 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453934 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453937 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453940 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453942 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453944 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.453947 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.453952 2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.464048 2532 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.464066 2532 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.464992 2532 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.465004 2532 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465066 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465071 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465075 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:17:14.465653 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465079 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465083 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465087 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465090 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465093 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465096 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465099 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465101 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465104 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465107 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465110 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465113 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465115 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465118 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465121 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465124 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465126 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465128 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465143 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:17:14.466009 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465146 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465149 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465153 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465155 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465158 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465161 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465163 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465167 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465170 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465173 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465175 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465178 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465180 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465183 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465185 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465188 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465191 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465193 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465196 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465198 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:17:14.466499 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465201 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465204 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465206 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465209 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465212 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465214 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465217 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465219 2532 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465222 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465225 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465227 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465230 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465233 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465236 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465238 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465241 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465243 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465246 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465248 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465252 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:17:14.466979 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465254 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465257 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465260 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465262 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465265 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465268 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465272 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465275 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465278 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465281 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465283 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465286 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465288 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465291 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465294 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465296 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465299 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465303 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465305 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:17:14.467523 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465308 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465310 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465313 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465317 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465320 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465323 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465326 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465329 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465332 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465335 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465337 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465340 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465344 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465348 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465350 2532 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465353 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465356 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:17:14.467997 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465359 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.465364 2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465502 2532 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465507 2532 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465510 2532 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465513 2532 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465516 2532 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465519 2532 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465522 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465525 2532 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465528 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465530 2532 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465533 2532 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465535 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465538 2532 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 10:17:14.468479 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465541 2532 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465543 2532 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465546 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465548 2532 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465551 2532 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465554 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465556 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465559 2532 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465561 2532 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465564 2532 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465567 2532 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465569 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465572 2532 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465575 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465578 2532 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465580 2532 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465583 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465586 2532 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465588 2532 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465590 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 10:17:14.468849 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465593 2532 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465595 2532 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465598 2532 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465601 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465603 2532 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465605 2532 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465608 2532 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465610 2532 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465613 2532 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465615 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465618 2532 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465620 2532 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465623 2532 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465626 2532 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465628 2532 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465631 2532 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465633 2532 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465636 2532 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465638 2532 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465641 2532 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 10:17:14.469355 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465643 2532 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465646 2532 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465648 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465651 2532 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465654 2532 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465657 2532 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465660 2532 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465664 2532 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465668 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465671 2532 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465674 2532 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465676 2532 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465679 2532 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465682 2532 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465686 2532 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465689 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465692 2532 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465695 2532 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465698 2532 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 10:17:14.469827 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465700 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465703 2532 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465705 2532 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465708 2532 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465710 2532 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465713 2532 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465720 2532 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465722 2532 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465725 2532 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465729 2532 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465732 2532 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465735 2532 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465738 2532 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465741 2532 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465743 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465746 2532 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465748 2532 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465751 2532 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465754 2532 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465756 2532 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 10:17:14.470301 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465759 2532 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465762 2532 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465764 2532 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465767 2532 feature_gate.go:328] unrecognized feature gate: Example Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465769 2532 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465772 2532 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:14.465775 2532 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.465780 2532 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.465890 2532 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.468454 2532 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.469466 2532 server.go:1019] "Starting client certificate rotation" Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.469566 2532 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 10:17:14.470774 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.469599 2532 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 10:17:14.472257 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.472237 2532 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 10:17:14.474379 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.474356 2532 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 10:17:14.483064 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.483046 2532 log.go:25] "Validated CRI v1 runtime API" Sep 08 10:17:14.486645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.486621 2532 log.go:25] "Validated CRI v1 image API" Sep 08 10:17:14.488831 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.488812 2532 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 10:17:14.493189 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.493166 2532 fs.go:135] Filesystem UUIDs: map[1054b550-efed-4741-9063-652515824266:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94e7abec-24c4-4118-af4c-18c5e35b4b23:/dev/nvme0n1p3] Sep 08 10:17:14.493260 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.493188 2532 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 10:17:14.500766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.500650 2532 manager.go:216] Machine: {Timestamp:2026-09-08 10:17:14.499152648 +0000 UTC m=+0.385862153 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099804 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d429fac02b40b68ef89c8d7fc862c SystemUUID:ec2d429f-ac02-b40b-68ef-89c8d7fc862c BootID:c14e7586-f177-48f2-86fa-5ee77718a76c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:df:1f:47:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:df:1f:47:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:ba:2d:fb:92:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 10:17:14.500766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.500756 2532 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 10:17:14.500932 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.500918 2532 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 10:17:14.503965 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.503946 2532 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 10:17:14.504913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.504887 2532 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 10:17:14.505056 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.504918 2532 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 10:17:14.505808 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.505797 2532 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 10:17:14.505846 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.505811 2532 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 10:17:14.505846 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.505819 2532 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 10:17:14.506533 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.506521 2532 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 10:17:14.508356 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.508346 2532 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 10:17:14.512942 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.512929 2532 state_mem.go:36] "Initialized new in-memory state store" Sep 08 10:17:14.513065 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513055 2532 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 10:17:14.513101 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513086 2532 kubelet.go:486] "Attempting to sync node with API server" Sep 08 10:17:14.513101 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513097 2532 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 10:17:14.513174 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513115 2532 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 10:17:14.513174 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513124 2532 kubelet.go:398] "Adding apiserver pod source" Sep 08 10:17:14.513174 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513151 2532 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 10:17:14.513547 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513535 2532 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 10:17:14.513579 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.513555 2532 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 10:17:14.516030 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.516014 2532 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 10:17:14.519318 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519297 2532 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 10:17:14.519399 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519333 2532 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 10:17:14.519536 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519524 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 10:17:14.519591 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519541 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 10:17:14.519591 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519553 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 10:17:14.519591 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519561 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 10:17:14.519591 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519573 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 10:17:14.519591 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.519583 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 10:17:14.520214 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.520203 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 10:17:14.520214 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.520213 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 10:17:14.520297 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.520220 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 10:17:14.520297 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.520226 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 10:17:14.520297 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.520237 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 10:17:14.520297 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.520246 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 10:17:14.521434 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.521414 2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 10:17:14.521434 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.521418 2532 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 10:17:14.522026 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.522012 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 10:17:14.522062 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.522030 2532 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 10:17:14.524490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.524467 2532 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 10:17:14.525987 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.525972 2532 server.go:1268] "Started kubelet" Sep 08 10:17:14.526119 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.526057 2532 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 10:17:14.526190 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.526100 2532 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 10:17:14.526190 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.526188 2532 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 10:17:14.526799 ip-10-0-134-85 systemd[1]: Started Kubernetes Kubelet. Sep 08 10:17:14.527796 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.527742 2532 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 10:17:14.528284 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.528270 2532 server.go:310] "Adding debug handlers to kubelet server" Sep 08 10:17:14.530362 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.530343 2532 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmr72" Sep 08 10:17:14.531002 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.530986 2532 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 10:17:14.534095 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.534079 2532 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 10:17:14.534271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.534251 2532 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 10:17:14.534429 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.534401 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:14.535015 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.534995 2532 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 10:17:14.535015 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.534996 2532 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 10:17:14.535165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535027 2532 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 10:17:14.535165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535089 2532 factory.go:55] Registering systemd factory Sep 08 10:17:14.535165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535106 2532 reconstruct.go:97] "Volume reconstruction finished" Sep 08 10:17:14.535165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535116 2532 reconciler.go:29] "Reconciler: start to sync state" Sep 08 10:17:14.535165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535120 2532 factory.go:223] Registration of the systemd container factory successfully Sep 08 10:17:14.535439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535373 2532 factory.go:153] Registering CRI-O factory Sep 08 10:17:14.535439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535390 2532 factory.go:223] Registration of the crio container factory successfully Sep 08 10:17:14.535439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535430 2532 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 10:17:14.535439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535448 2532 factory.go:103] Registering Raw factory Sep 08 10:17:14.535439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.535467 2532 manager.go:1196] Started watching for new ooms in manager Sep 08 10:17:14.536724 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.536706 2532 manager.go:349] Starting recovery of all containers Sep 08 10:17:14.538657 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.537564 2532 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmr72" Sep 08 10:17:14.545560 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.545493 2532 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 10:17:14.545651 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.545627 2532 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 10:17:14.546740 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.545510 2532 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-85.ec2.internal.18d351169ae368b4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-85.ec2.internal,UID:ip-10-0-134-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-85.ec2.internal,},FirstTimestamp:2026-09-08 10:17:14.525943988 +0000 UTC m=+0.412653472,LastTimestamp:2026-09-08 10:17:14.525943988 +0000 UTC m=+0.412653472,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-85.ec2.internal,}" Sep 08 10:17:14.549236 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.549206 2532 manager.go:354] Recovery completed Sep 08 10:17:14.553448 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.553436 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.555003 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.554982 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.555077 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.555018 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.555077 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.555034 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.555510 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.555495 2532 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 10:17:14.555510 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.555510 2532 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 10:17:14.555629 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.555524 2532 state_mem.go:36] "Initialized new in-memory state store" Sep 08 10:17:14.555629 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.555566 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.557109 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.557093 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.557194 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.557117 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.557194 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.557130 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.557479 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.557466 2532 policy_none.go:49] "None policy: Start" Sep 08 10:17:14.557557 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.557486 2532 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 10:17:14.557557 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.557500 2532 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 10:17:14.559434 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.559421 2532 policy_none.go:47] "Start" Sep 08 10:17:14.607752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.607734 2532 manager.go:337] "Starting Device Plugin manager" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.607777 2532 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.607793 2532 server.go:87] "Starting device plugin registration server" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.608073 2532 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.608086 2532 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.608194 2532 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.608279 2532 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.608289 2532 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.608877 2532 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 10:17:14.625867 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.608915 2532 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:14.651741 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.651708 2532 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 10:17:14.653070 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.653050 2532 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 10:17:14.653161 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.653110 2532 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 10:17:14.653161 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.653154 2532 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 10:17:14.653257 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.653201 2532 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 10:17:14.655394 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.655369 2532 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:17:14.708993 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.708922 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.709862 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.709846 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.709939 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.709876 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.709939 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.709886 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.709939 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.709912 2532 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.716941 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.716926 2532 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.716995 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.716948 2532 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-85.ec2.internal\": node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:14.732817 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.732797 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:14.753332 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.753304 2532 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal"] Sep 08 10:17:14.753470 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.753371 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.754731 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.754704 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.754838 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.754744 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.754838 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.754754 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.756932 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.756917 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.757101 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757087 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.757171 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757121 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.757677 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757661 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.757752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757686 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.757752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757695 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.757752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757703 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.757752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757715 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.757752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.757724 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.759915 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.759898 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.759959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.759930 2532 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 10:17:14.760703 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.760690 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientMemory" Sep 08 10:17:14.760763 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.760730 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 10:17:14.760763 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.760741 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeHasSufficientPID" Sep 08 10:17:14.787819 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.787797 2532 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-85.ec2.internal\" not found" node="ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.792084 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.792063 2532 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-85.ec2.internal\" not found" node="ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.833414 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.833384 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:14.836714 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.836694 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a61fe91c7cc9dcf385d8fba2652fdc44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"a61fe91c7cc9dcf385d8fba2652fdc44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.836785 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.836726 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61fe91c7cc9dcf385d8fba2652fdc44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"a61fe91c7cc9dcf385d8fba2652fdc44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.836785 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.836747 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c46abc7be8f37118f6a71adbc1c290-config\") pod \"kube-apiserver-proxy-ip-10-0-134-85.ec2.internal\" (UID: \"49c46abc7be8f37118f6a71adbc1c290\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.933611 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:14.933583 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:14.936856 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.936836 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c46abc7be8f37118f6a71adbc1c290-config\") pod \"kube-apiserver-proxy-ip-10-0-134-85.ec2.internal\" (UID: \"49c46abc7be8f37118f6a71adbc1c290\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.936903 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.936864 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a61fe91c7cc9dcf385d8fba2652fdc44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"a61fe91c7cc9dcf385d8fba2652fdc44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.936944 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.936883 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61fe91c7cc9dcf385d8fba2652fdc44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"a61fe91c7cc9dcf385d8fba2652fdc44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.936944 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.936937 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a61fe91c7cc9dcf385d8fba2652fdc44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"a61fe91c7cc9dcf385d8fba2652fdc44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.937006 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.936948 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a61fe91c7cc9dcf385d8fba2652fdc44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal\" (UID: \"a61fe91c7cc9dcf385d8fba2652fdc44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:14.937006 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:14.936955 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c46abc7be8f37118f6a71adbc1c290-config\") pod \"kube-apiserver-proxy-ip-10-0-134-85.ec2.internal\" (UID: \"49c46abc7be8f37118f6a71adbc1c290\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Sep 08 10:17:15.034359 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.034279 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.090696 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.090671 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:15.094690 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.094220 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Sep 08 10:17:15.134959 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.134931 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.235392 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.235345 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.335883 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.335800 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.382740 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.382716 2532 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:17:15.436815 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.436786 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.469101 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.469079 2532 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 10:17:15.469489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.469234 2532 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 10:17:15.469489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.469283 2532 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 10:17:15.537024 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.536998 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.541390 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.541358 2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 10:12:15 +0000 UTC" deadline="2028-02-23 01:00:03.549059563 +0000 UTC" Sep 08 10:17:15.541390 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.541385 2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12782h42m48.007678047s" Sep 08 10:17:15.637608 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:15.637408 2532 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-85.ec2.internal\" not found" Sep 08 10:17:15.701630 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.701603 2532 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:17:15.734507 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.734481 2532 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" Sep 08 10:17:15.742222 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.742194 2532 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:17:15.745902 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.745881 2532 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 10:17:15.746845 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.746827 2532 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" Sep 08 10:17:15.756594 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.756568 2532 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 10:17:15.791856 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:15.791816 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61fe91c7cc9dcf385d8fba2652fdc44.slice/crio-1f1d92e87cab952dab9b2f10e589060c0e4d17c5a8b0302c2561a1074053849d WatchSource:0}: Error finding container 1f1d92e87cab952dab9b2f10e589060c0e4d17c5a8b0302c2561a1074053849d: Status 404 returned error can't find the container with id 1f1d92e87cab952dab9b2f10e589060c0e4d17c5a8b0302c2561a1074053849d Sep 08 10:17:15.798218 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:15.798199 2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:17:15.801796 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:15.801777 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c46abc7be8f37118f6a71adbc1c290.slice/crio-4336a2d6ed232cae77a956261ab5e190cc4479f41d0a932e9d52b979cf21695e WatchSource:0}: Error finding container 4336a2d6ed232cae77a956261ab5e190cc4479f41d0a932e9d52b979cf21695e: Status 404 returned error can't find the container with id 4336a2d6ed232cae77a956261ab5e190cc4479f41d0a932e9d52b979cf21695e Sep 08 10:17:16.512876 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.512784 2532 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:17:16.513963 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.513945 2532 apiserver.go:52] "Watching apiserver" Sep 08 10:17:16.525912 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.525883 2532 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 10:17:16.526290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.526269 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-qhqt2","kube-system/konnectivity-agent-ddwr4","kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l","openshift-cluster-node-tuning-operator/tuned-tjhwb","openshift-dns/node-resolver-7krmk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal","openshift-multus/multus-additional-cni-plugins-vw7fl","openshift-multus/network-metrics-daemon-rlbmt","kube-system/global-pull-secret-syncer-2b2ct","openshift-image-registry/node-ca-x5vlj","openshift-multus/multus-hl4wb","openshift-network-diagnostics/network-check-target-b86ls","openshift-network-operator/iptables-alerter-tq5h9"] Sep 08 10:17:16.529310 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.529293 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.529383 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.529364 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:16.531439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.531423 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:16.531491 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.531477 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:16.533581 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.533564 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.534727 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.534694 2532 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 10:17:16.537049 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.536998 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.537298 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.537277 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wxclr\"" Sep 08 10:17:16.537388 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.537282 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.537540 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.537518 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.537897 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.537882 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 10:17:16.539231 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.539199 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.539620 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.539598 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.539900 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.539871 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.540000 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.539947 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 10:17:16.540074 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.540056 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lr66n\"" Sep 08 10:17:16.541403 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.541383 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xdchj\"" Sep 08 10:17:16.541565 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.541547 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.543255 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.543240 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.543843 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.543826 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.543945 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.543832 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.544024 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.543941 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:16.544024 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.544003 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:16.544152 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.544083 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-txchj\"" Sep 08 10:17:16.544477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.544458 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.545013 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.544992 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-etc-selinux\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.545083 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545029 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-sys-fs\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.545083 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545059 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa45e7d-f861-4a82-9355-62781f6cf75b-dbus\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.545193 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545084 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.545193 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545104 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:16.545193 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545128 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z4q4\" (UniqueName: \"kubernetes.io/projected/9394da66-c253-462e-a139-3ea6c54b6f20-kube-api-access-2z4q4\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.545395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545178 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbmsp\" (UniqueName: \"kubernetes.io/projected/fe7a623c-ebea-49e4-95b4-12b6e273c368-kube-api-access-sbmsp\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.545395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545228 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa45e7d-f861-4a82-9355-62781f6cf75b-kubelet-config\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.545395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545253 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9394da66-c253-462e-a139-3ea6c54b6f20-iptables-alerter-script\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.545395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545302 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-registration-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.545395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545345 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.545395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545374 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-socket-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.545735 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545401 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9394da66-c253-462e-a139-3ea6c54b6f20-host-slash\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.545735 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.545424 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-device-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.546473 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.546456 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.548903 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.548830 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.549544 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.549529 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.549681 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.549663 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 10:17:16.550261 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.550202 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 10:17:16.550353 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.550339 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 10:17:16.550832 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.550816 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.551381 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.551360 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w4lwh\"" Sep 08 10:17:16.551477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.551450 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.553916 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.553884 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 10:17:16.554753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.554563 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fdk2w\"" Sep 08 10:17:16.554753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.554596 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 10:17:16.554753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.554663 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 10:17:16.556383 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556348 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 10:17:16.556484 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556359 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.557226 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556613 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.557226 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556618 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 10:17:16.557226 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556657 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xfn4b\"" Sep 08 10:17:16.557226 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556875 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 10:17:16.557226 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.556972 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.559336 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.559321 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.564155 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.564124 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 10:17:16.564258 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.564129 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 10:17:16.564312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.564290 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:17:16.564312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.564290 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mrrh5\"" Sep 08 10:17:16.565372 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.565354 2532 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 10:17:16.568903 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.568889 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mr95b\"" Sep 08 10:17:16.571130 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.571112 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 10:17:16.587787 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.587767 2532 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jl5j8" Sep 08 10:17:16.599498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.599479 2532 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jl5j8" Sep 08 10:17:16.635833 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.635806 2532 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 10:17:16.646191 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646162 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-run\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.646316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646207 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.646316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646241 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-run-ovn-kubernetes\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.646316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646268 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-hostroot\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.646316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646299 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9394da66-c253-462e-a139-3ea6c54b6f20-host-slash\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.646482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646330 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-sys-fs\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.646482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646391 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-sys-fs\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.646482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646423 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-var-lib-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.646482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646423 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9394da66-c253-462e-a139-3ea6c54b6f20-host-slash\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.646482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646449 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.646482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646467 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42116614-b54c-4c7a-b55b-76b573209685-serviceca\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646497 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9de127b1-2c05-4b2f-8645-e5aa4352da22-cni-binary-copy\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646520 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-netns\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646546 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbmsp\" (UniqueName: \"kubernetes.io/projected/fe7a623c-ebea-49e4-95b4-12b6e273c368-kube-api-access-sbmsp\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646590 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-modprobe-d\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646617 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysctl-conf\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646658 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-cnibin\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646699 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646725 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-env-overrides\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646752 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysctl-d\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.646778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646783 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933214fb-4f09-4163-a330-8a1512012a8f-tmp\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646807 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-cni-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646841 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646891 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-k8s-cni-cncf-io\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646944 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flg4g\" (UniqueName: \"kubernetes.io/projected/9de127b1-2c05-4b2f-8645-e5aa4352da22-kube-api-access-flg4g\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.646975 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8gd\" (UniqueName: \"kubernetes.io/projected/ad1d3048-607f-44b9-8939-1278844d4b7a-kube-api-access-qz8gd\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647007 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-device-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647027 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647046 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-etc-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647067 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-cni-bin\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647074 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-device-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647083 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6a9cfea-072a-4702-8736-7157612f501a-ovn-node-metrics-cert\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647102 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-kubelet\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647171 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z4q4\" (UniqueName: \"kubernetes.io/projected/9394da66-c253-462e-a139-3ea6c54b6f20-kube-api-access-2z4q4\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647193 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-ovn\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647208 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-cni-netd\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.647309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647223 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-kubernetes\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647260 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1eaa6ddb-ba08-499c-9561-fb63cffc6dc8-konnectivity-ca\") pod \"konnectivity-agent-ddwr4\" (UID: \"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8\") " pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647282 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-daemon-config\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647296 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647331 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-log-socket\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647369 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-ovnkube-script-lib\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647391 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42116614-b54c-4c7a-b55b-76b573209685-host\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647408 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysconfig\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647431 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-lib-modules\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647490 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-host\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647538 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-etc-kubernetes\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647572 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-socket-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647602 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9mrp\" (UniqueName: \"kubernetes.io/projected/933214fb-4f09-4163-a330-8a1512012a8f-kube-api-access-m9mrp\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647630 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-cni-bin\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647661 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa45e7d-f861-4a82-9355-62781f6cf75b-dbus\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647691 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647720 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:16.648089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647753 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2x7c\" (UniqueName: \"kubernetes.io/projected/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-kube-api-access-n2x7c\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647784 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-cni-multus\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647838 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-systemd\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.647863 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647868 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-ovnkube-config\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647875 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa45e7d-f861-4a82-9355-62781f6cf75b-dbus\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.647929 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf5z9\" (UniqueName: \"kubernetes.io/projected/c6a9cfea-072a-4702-8736-7157612f501a-kube-api-access-lf5z9\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.648001 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:17:17.147949986 +0000 UTC m=+3.034659479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648024 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr4tl\" (UniqueName: \"kubernetes.io/projected/42116614-b54c-4c7a-b55b-76b573209685-kube-api-access-zr4tl\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648070 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-registration-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648105 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cnibin\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648131 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-kubelet\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648162 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-run-netns\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648164 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-registration-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648195 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-sys\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648241 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-var-lib-kubelet\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.648995 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648279 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-socket-dir-parent\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648306 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-multus-certs\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648336 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648353 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-socket-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648363 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48bcb\" (UniqueName: \"kubernetes.io/projected/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-kube-api-access-48bcb\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648391 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-system-cni-dir\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648398 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648420 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648447 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-system-cni-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648474 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad1d3048-607f-44b9-8939-1278844d4b7a-hosts-file\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648505 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-etc-selinux\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648533 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-node-log\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648554 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/933214fb-4f09-4163-a330-8a1512012a8f-etc-tuned\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648578 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1eaa6ddb-ba08-499c-9561-fb63cffc6dc8-agent-certs\") pod \"konnectivity-agent-ddwr4\" (UID: \"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8\") " pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648599 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe7a623c-ebea-49e4-95b4-12b6e273c368-etc-selinux\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648606 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa45e7d-f861-4a82-9355-62781f6cf75b-kubelet-config\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648654 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-conf-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.649745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648654 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa45e7d-f861-4a82-9355-62781f6cf75b-kubelet-config\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:16.650461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648689 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1d3048-607f-44b9-8939-1278844d4b7a-tmp-dir\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.650461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648709 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9394da66-c253-462e-a139-3ea6c54b6f20-iptables-alerter-script\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.650461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648725 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-systemd-units\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.650461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648740 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-slash\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.650461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.648762 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-systemd\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.650461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.649296 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9394da66-c253-462e-a139-3ea6c54b6f20-iptables-alerter-script\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.659817 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.659770 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" event={"ID":"49c46abc7be8f37118f6a71adbc1c290","Type":"ContainerStarted","Data":"4336a2d6ed232cae77a956261ab5e190cc4479f41d0a932e9d52b979cf21695e"} Sep 08 10:17:16.661614 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.661326 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" event={"ID":"a61fe91c7cc9dcf385d8fba2652fdc44","Type":"ContainerStarted","Data":"1f1d92e87cab952dab9b2f10e589060c0e4d17c5a8b0302c2561a1074053849d"} Sep 08 10:17:16.665894 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.665864 2532 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 10:17:16.669842 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.669781 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:16.669842 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.669811 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:16.669842 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.669826 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:16.670052 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.669902 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:17:17.16987961 +0000 UTC m=+3.056589107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:16.671082 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.671059 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbmsp\" (UniqueName: \"kubernetes.io/projected/fe7a623c-ebea-49e4-95b4-12b6e273c368-kube-api-access-sbmsp\") pod \"aws-ebs-csi-driver-node-6f65l\" (UID: \"fe7a623c-ebea-49e4-95b4-12b6e273c368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.673870 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.673845 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z4q4\" (UniqueName: \"kubernetes.io/projected/9394da66-c253-462e-a139-3ea6c54b6f20-kube-api-access-2z4q4\") pod \"iptables-alerter-tq5h9\" (UID: \"9394da66-c253-462e-a139-3ea6c54b6f20\") " pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.749078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749036 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42116614-b54c-4c7a-b55b-76b573209685-serviceca\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.749078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749091 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9de127b1-2c05-4b2f-8645-e5aa4352da22-cni-binary-copy\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749122 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-netns\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749150 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-modprobe-d\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749193 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysctl-conf\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749208 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-netns\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749218 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-cnibin\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749282 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-cnibin\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749284 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749319 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-env-overrides\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749351 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysctl-d\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749361 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-modprobe-d\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.749377 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749377 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933214fb-4f09-4163-a330-8a1512012a8f-tmp\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.749403 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749405 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysctl-conf\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749404 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-cni-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:16.749472 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:17:17.24945136 +0000 UTC m=+3.136160857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749491 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749517 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-k8s-cni-cncf-io\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749520 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-cni-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749544 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flg4g\" (UniqueName: \"kubernetes.io/projected/9de127b1-2c05-4b2f-8645-e5aa4352da22-kube-api-access-flg4g\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749571 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8gd\" (UniqueName: \"kubernetes.io/projected/ad1d3048-607f-44b9-8939-1278844d4b7a-kube-api-access-qz8gd\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749597 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749623 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-etc-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749646 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-cni-bin\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749669 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6a9cfea-072a-4702-8736-7157612f501a-ovn-node-metrics-cert\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749692 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-kubelet\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749720 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-ovn\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749729 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42116614-b54c-4c7a-b55b-76b573209685-serviceca\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.749929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749744 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-cni-netd\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749794 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-kubernetes\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749837 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1eaa6ddb-ba08-499c-9561-fb63cffc6dc8-konnectivity-ca\") pod \"konnectivity-agent-ddwr4\" (UID: \"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8\") " pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749847 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-k8s-cni-cncf-io\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749836 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-env-overrides\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749847 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9de127b1-2c05-4b2f-8645-e5aa4352da22-cni-binary-copy\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749545 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysctl-d\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749884 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-kubelet\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749908 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-daemon-config\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749942 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749951 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-etc-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749966 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-log-socket\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749992 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-ovnkube-script-lib\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750004 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-cni-bin\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750015 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42116614-b54c-4c7a-b55b-76b573209685-host\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750039 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysconfig\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750060 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-lib-modules\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750085 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-host\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.751059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750107 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-etc-kubernetes\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750134 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9mrp\" (UniqueName: \"kubernetes.io/projected/933214fb-4f09-4163-a330-8a1512012a8f-kube-api-access-m9mrp\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750160 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-cni-bin\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750149 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-log-socket\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750230 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-cni-netd\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750262 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-cni-bin\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.749910 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-ovn\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750262 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2x7c\" (UniqueName: \"kubernetes.io/projected/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-kube-api-access-n2x7c\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750327 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-sysconfig\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750334 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42116614-b54c-4c7a-b55b-76b573209685-host\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750409 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1eaa6ddb-ba08-499c-9561-fb63cffc6dc8-konnectivity-ca\") pod \"konnectivity-agent-ddwr4\" (UID: \"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8\") " pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750420 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-lib-modules\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750455 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-cni-multus\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750475 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750484 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-systemd\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750522 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-etc-kubernetes\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750525 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-run-systemd\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750573 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-host\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750600 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-ovnkube-config\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750627 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf5z9\" (UniqueName: \"kubernetes.io/projected/c6a9cfea-072a-4702-8736-7157612f501a-kube-api-access-lf5z9\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750652 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr4tl\" (UniqueName: \"kubernetes.io/projected/42116614-b54c-4c7a-b55b-76b573209685-kube-api-access-zr4tl\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750678 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cnibin\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750713 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-kubelet\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750740 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-run-netns\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750750 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750764 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-sys\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750788 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-var-lib-kubelet\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750799 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cnibin\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750814 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-socket-dir-parent\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750835 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-sys\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750840 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-multus-certs\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750852 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-ovnkube-script-lib\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750864 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-run-netns\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750740 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-var-lib-cni-multus\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750871 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48bcb\" (UniqueName: \"kubernetes.io/projected/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-kube-api-access-48bcb\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:16.752807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750837 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-daemon-config\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750898 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-system-cni-dir\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750918 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-host-run-multus-certs\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750926 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-var-lib-kubelet\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750925 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.750943 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-kubelet\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751004 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-system-cni-dir\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751017 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-socket-dir-parent\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751037 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-system-cni-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751067 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad1d3048-607f-44b9-8939-1278844d4b7a-hosts-file\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751076 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751109 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-node-log\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751115 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-kubernetes\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751124 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad1d3048-607f-44b9-8939-1278844d4b7a-hosts-file\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751138 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/933214fb-4f09-4163-a330-8a1512012a8f-etc-tuned\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751149 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-system-cni-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751165 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-node-log\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751166 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1eaa6ddb-ba08-499c-9561-fb63cffc6dc8-agent-certs\") pod \"konnectivity-agent-ddwr4\" (UID: \"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8\") " pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.753477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751203 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-conf-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751262 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1d3048-607f-44b9-8939-1278844d4b7a-tmp-dir\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751292 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-systemd-units\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751311 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-multus-conf-dir\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751316 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-slash\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751352 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-slash\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751368 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-systemd\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751385 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c6a9cfea-072a-4702-8736-7157612f501a-ovnkube-config\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751402 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-run\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751430 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751450 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-systemd-units\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751459 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-run-ovn-kubernetes\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751484 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-hostroot\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751500 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-run\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751512 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-var-lib-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751540 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751547 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/933214fb-4f09-4163-a330-8a1512012a8f-etc-systemd\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.754311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751614 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751622 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad1d3048-607f-44b9-8939-1278844d4b7a-tmp-dir\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751650 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-host-run-ovn-kubernetes\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751686 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9de127b1-2c05-4b2f-8645-e5aa4352da22-hostroot\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751712 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c6a9cfea-072a-4702-8736-7157612f501a-var-lib-openvswitch\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.751768 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.752105 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.753891 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/933214fb-4f09-4163-a330-8a1512012a8f-etc-tuned\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.755241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.754506 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1eaa6ddb-ba08-499c-9561-fb63cffc6dc8-agent-certs\") pod \"konnectivity-agent-ddwr4\" (UID: \"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8\") " pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.755990 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.755964 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933214fb-4f09-4163-a330-8a1512012a8f-tmp\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.757680 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.757657 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c6a9cfea-072a-4702-8736-7157612f501a-ovn-node-metrics-cert\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.831206 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.831120 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flg4g\" (UniqueName: \"kubernetes.io/projected/9de127b1-2c05-4b2f-8645-e5aa4352da22-kube-api-access-flg4g\") pod \"multus-hl4wb\" (UID: \"9de127b1-2c05-4b2f-8645-e5aa4352da22\") " pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.836642 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.836494 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2x7c\" (UniqueName: \"kubernetes.io/projected/876c61ed-2c19-45d1-b8bd-7f003c76ecbe-kube-api-access-n2x7c\") pod \"multus-additional-cni-plugins-vw7fl\" (UID: \"876c61ed-2c19-45d1-b8bd-7f003c76ecbe\") " pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.837937 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.837912 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8gd\" (UniqueName: \"kubernetes.io/projected/ad1d3048-607f-44b9-8939-1278844d4b7a-kube-api-access-qz8gd\") pod \"node-resolver-7krmk\" (UID: \"ad1d3048-607f-44b9-8939-1278844d4b7a\") " pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.838778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.838750 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr4tl\" (UniqueName: \"kubernetes.io/projected/42116614-b54c-4c7a-b55b-76b573209685-kube-api-access-zr4tl\") pod \"node-ca-x5vlj\" (UID: \"42116614-b54c-4c7a-b55b-76b573209685\") " pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.838944 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.838922 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48bcb\" (UniqueName: \"kubernetes.io/projected/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-kube-api-access-48bcb\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:16.839489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.839444 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf5z9\" (UniqueName: \"kubernetes.io/projected/c6a9cfea-072a-4702-8736-7157612f501a-kube-api-access-lf5z9\") pod \"ovnkube-node-qhqt2\" (UID: \"c6a9cfea-072a-4702-8736-7157612f501a\") " pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.839869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.839844 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9mrp\" (UniqueName: \"kubernetes.io/projected/933214fb-4f09-4163-a330-8a1512012a8f-kube-api-access-m9mrp\") pod \"tuned-tjhwb\" (UID: \"933214fb-4f09-4163-a330-8a1512012a8f\") " pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.844968 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.844946 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tq5h9" Sep 08 10:17:16.855184 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.855155 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" Sep 08 10:17:16.863101 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.863082 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" Sep 08 10:17:16.867791 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.867761 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7a623c_ebea_49e4_95b4_12b6e273c368.slice/crio-7fc21f38e3d9df2eca03c4e918fc3be69823e28620a3ea52ff300667615c31fe WatchSource:0}: Error finding container 7fc21f38e3d9df2eca03c4e918fc3be69823e28620a3ea52ff300667615c31fe: Status 404 returned error can't find the container with id 7fc21f38e3d9df2eca03c4e918fc3be69823e28620a3ea52ff300667615c31fe Sep 08 10:17:16.869035 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.868845 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7krmk" Sep 08 10:17:16.873395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.873377 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" Sep 08 10:17:16.877567 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.877538 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933214fb_4f09_4163_a330_8a1512012a8f.slice/crio-c7f432b7e0f6fe66defbe41d8bf2000b0b0055974a2858fc6eff64fa105da8a9 WatchSource:0}: Error finding container c7f432b7e0f6fe66defbe41d8bf2000b0b0055974a2858fc6eff64fa105da8a9: Status 404 returned error can't find the container with id c7f432b7e0f6fe66defbe41d8bf2000b0b0055974a2858fc6eff64fa105da8a9 Sep 08 10:17:16.878970 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.878799 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:16.886186 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.886144 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:16.886536 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.886507 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876c61ed_2c19_45d1_b8bd_7f003c76ecbe.slice/crio-4991fb944129835ee4bdd091e972eb128e9e31456f9ace0174b0b1c208321372 WatchSource:0}: Error finding container 4991fb944129835ee4bdd091e972eb128e9e31456f9ace0174b0b1c208321372: Status 404 returned error can't find the container with id 4991fb944129835ee4bdd091e972eb128e9e31456f9ace0174b0b1c208321372 Sep 08 10:17:16.890202 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.890172 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eaa6ddb_ba08_499c_9561_fb63cffc6dc8.slice/crio-b3644be62f9997b158f981991504527698ac38bec56c0fef9551da3101231f04 WatchSource:0}: Error finding container b3644be62f9997b158f981991504527698ac38bec56c0fef9551da3101231f04: Status 404 returned error can't find the container with id b3644be62f9997b158f981991504527698ac38bec56c0fef9551da3101231f04 Sep 08 10:17:16.891197 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.891060 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x5vlj" Sep 08 10:17:16.896726 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.896701 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a9cfea_072a_4702_8736_7157612f501a.slice/crio-b5e749af75af9ff28ebb8ff2f7a1bc4927b941b9aaf21f1dace2fc2ebea663c0 WatchSource:0}: Error finding container b5e749af75af9ff28ebb8ff2f7a1bc4927b941b9aaf21f1dace2fc2ebea663c0: Status 404 returned error can't find the container with id b5e749af75af9ff28ebb8ff2f7a1bc4927b941b9aaf21f1dace2fc2ebea663c0 Sep 08 10:17:16.897534 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:16.897497 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hl4wb" Sep 08 10:17:16.902237 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.902188 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42116614_b54c_4c7a_b55b_76b573209685.slice/crio-b9aedc901db4ab1344b7ded0d988374c8821b4f034dffdb5615349fcfd1078b1 WatchSource:0}: Error finding container b9aedc901db4ab1344b7ded0d988374c8821b4f034dffdb5615349fcfd1078b1: Status 404 returned error can't find the container with id b9aedc901db4ab1344b7ded0d988374c8821b4f034dffdb5615349fcfd1078b1 Sep 08 10:17:16.909336 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:16.909306 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de127b1_2c05_4b2f_8645_e5aa4352da22.slice/crio-11798db9af3374bcba7fbf77ab00d18d2adfbcd60dff7f12ef74211078c1eac6 WatchSource:0}: Error finding container 11798db9af3374bcba7fbf77ab00d18d2adfbcd60dff7f12ef74211078c1eac6: Status 404 returned error can't find the container with id 11798db9af3374bcba7fbf77ab00d18d2adfbcd60dff7f12ef74211078c1eac6 Sep 08 10:17:17.155745 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.155641 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:17.155889 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.155817 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:17.155954 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.155893 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:17:18.155875358 +0000 UTC m=+4.042584846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:17.256413 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.256372 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:17.256590 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.256440 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:17.256590 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.256573 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:17.256734 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.256593 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:17.256734 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.256607 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:17.256734 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.256632 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:17.256734 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.256668 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:17:18.256650072 +0000 UTC m=+4.143359563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:17.256734 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.256688 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:17:18.256677936 +0000 UTC m=+4.143387410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:17.603066 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.602942 2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 10:12:17 +0000 UTC" deadline="2028-05-11 01:53:45.928502266 +0000 UTC" Sep 08 10:17:17.603066 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.603009 2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14655h36m28.325497507s" Sep 08 10:17:17.653685 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.653649 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:17.653857 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.653792 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:17.653941 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.653854 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:17.654061 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:17.654030 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:17.665527 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.665490 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ddwr4" event={"ID":"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8","Type":"ContainerStarted","Data":"b3644be62f9997b158f981991504527698ac38bec56c0fef9551da3101231f04"} Sep 08 10:17:17.667993 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.667962 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" event={"ID":"fe7a623c-ebea-49e4-95b4-12b6e273c368","Type":"ContainerStarted","Data":"7fc21f38e3d9df2eca03c4e918fc3be69823e28620a3ea52ff300667615c31fe"} Sep 08 10:17:17.670571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.670549 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hl4wb" event={"ID":"9de127b1-2c05-4b2f-8645-e5aa4352da22","Type":"ContainerStarted","Data":"11798db9af3374bcba7fbf77ab00d18d2adfbcd60dff7f12ef74211078c1eac6"} Sep 08 10:17:17.672689 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.672659 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x5vlj" event={"ID":"42116614-b54c-4c7a-b55b-76b573209685","Type":"ContainerStarted","Data":"b9aedc901db4ab1344b7ded0d988374c8821b4f034dffdb5615349fcfd1078b1"} Sep 08 10:17:17.675631 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.675603 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"b5e749af75af9ff28ebb8ff2f7a1bc4927b941b9aaf21f1dace2fc2ebea663c0"} Sep 08 10:17:17.677766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.677741 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerStarted","Data":"4991fb944129835ee4bdd091e972eb128e9e31456f9ace0174b0b1c208321372"} Sep 08 10:17:17.680366 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.680339 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7krmk" event={"ID":"ad1d3048-607f-44b9-8939-1278844d4b7a","Type":"ContainerStarted","Data":"63309fe3a9b16a5c89bf57314d3de86a75dcde0c291252d0e8c25bac25829b85"} Sep 08 10:17:17.681993 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.681966 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" event={"ID":"933214fb-4f09-4163-a330-8a1512012a8f","Type":"ContainerStarted","Data":"c7f432b7e0f6fe66defbe41d8bf2000b0b0055974a2858fc6eff64fa105da8a9"} Sep 08 10:17:17.683582 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.683556 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tq5h9" event={"ID":"9394da66-c253-462e-a139-3ea6c54b6f20","Type":"ContainerStarted","Data":"7adfdbe25145985c003dd7c38715cd1d0f38186a8c0b0ffb690b0520d9217316"} Sep 08 10:17:17.689599 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:17.689579 2532 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 10:17:18.164730 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.164628 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:18.164902 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.164798 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:18.164902 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.164872 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:17:20.16485092 +0000 UTC m=+6.051560395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.265979 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.266053 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.266220 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.266294 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:17:20.266270962 +0000 UTC m=+6.152980441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.266396 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.266416 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.266430 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:18.266881 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.266470 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:17:20.2664571 +0000 UTC m=+6.153166589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:18.603543 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.603431 2532 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 10:12:17 +0000 UTC" deadline="2028-03-02 13:30:52.294387404 +0000 UTC" Sep 08 10:17:18.603543 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.603481 2532 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12987h13m33.690911802s" Sep 08 10:17:18.655993 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.655955 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:18.656193 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:18.656099 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:18.694770 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:18.694022 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" event={"ID":"49c46abc7be8f37118f6a71adbc1c290","Type":"ContainerStarted","Data":"2aa6bf97380479ddd6d7f5a22c426b86ec328d98de0b29bc241378790536c9a4"} Sep 08 10:17:19.654126 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:19.653608 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:19.654126 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:19.653760 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:19.654126 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:19.653927 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:19.654126 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:19.654089 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:20.180818 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:20.180773 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:20.180997 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.180955 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:20.181044 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.181009 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:17:24.1809952 +0000 UTC m=+10.067704687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:20.281876 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:20.281834 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:20.282070 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:20.281921 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:20.282143 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.282094 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:20.282143 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.282117 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:20.282143 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.282130 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:20.282339 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.282215 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:17:24.282195311 +0000 UTC m=+10.168904800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:20.282642 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.282625 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:20.282714 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.282671 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:17:24.282658869 +0000 UTC m=+10.169368357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:20.653635 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:20.653546 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:20.653807 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:20.653709 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:21.654526 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:21.654488 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:21.655054 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:21.654638 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:21.655121 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:21.655074 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:21.655247 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:21.655173 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:22.655744 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:22.655147 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:22.655744 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:22.655338 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:23.653625 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:23.653370 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:23.653822 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:23.653427 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:23.653822 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:23.653738 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:23.653822 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:23.653804 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:24.215987 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:24.215945 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:24.216468 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.216095 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:24.216468 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.216167 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:17:32.216145886 +0000 UTC m=+18.102855370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:24.316852 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:24.316815 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:24.317027 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:24.316874 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:24.317027 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.317009 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:24.317027 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.317027 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:24.317198 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.317039 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:24.317198 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.317092 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:17:32.317076349 +0000 UTC m=+18.203785834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:24.317533 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.317508 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:24.317656 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.317561 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:17:32.317545919 +0000 UTC m=+18.204255405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:24.654569 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:24.654486 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:24.654729 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:24.654597 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:25.654289 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:25.654253 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:25.654728 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:25.654384 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:25.654775 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:25.654734 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:25.654816 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:25.654800 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:26.654401 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:26.654379 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:26.654712 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:26.654491 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:27.654357 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:27.654319 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:27.654507 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:27.654454 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:27.654507 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:27.654492 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:27.654850 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:27.654564 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:28.653478 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:28.653438 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:28.653645 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:28.653561 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:29.653364 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:29.653336 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:29.653802 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:29.653374 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:29.653802 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:29.653461 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:29.653802 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:29.653574 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:30.653759 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:30.653708 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:30.654263 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:30.653859 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:31.653880 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:31.653792 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:31.654327 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:31.653930 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:31.654327 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:31.653969 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:31.654327 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:31.654051 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:32.278462 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:32.278432 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:32.278603 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.278549 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:32.278603 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.278600 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:17:48.278587573 +0000 UTC m=+34.165297057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:32.379468 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:32.379381 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:32.379468 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:32.379448 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:32.379673 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.379570 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:32.379673 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.379573 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:32.379673 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.379607 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:32.379673 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.379617 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:32.379673 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.379643 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:17:48.379622962 +0000 UTC m=+34.266332454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:32.379673 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.379667 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:17:48.379651159 +0000 UTC m=+34.266360648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:32.654233 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:32.654130 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:32.654700 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:32.654293 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:33.654406 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:33.654365 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:33.654406 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:33.654406 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:33.654891 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:33.654512 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:33.654891 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:33.654624 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:34.654362 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:34.654330 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:34.654511 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:34.654462 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:35.653973 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:35.653926 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:35.654151 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:35.654055 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:35.654151 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:35.654096 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:35.654247 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:35.654217 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:36.654085 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.653814 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:36.654085 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:36.654091 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:36.732890 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.732850 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hl4wb" event={"ID":"9de127b1-2c05-4b2f-8645-e5aa4352da22","Type":"ContainerStarted","Data":"c8ce97678c3b8a55dff18cd1edd18e15155491baf80f9f98b4bdeace43fa86d6"} Sep 08 10:17:36.734343 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.734310 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x5vlj" event={"ID":"42116614-b54c-4c7a-b55b-76b573209685","Type":"ContainerStarted","Data":"2bd5aa21ad8a4730c36226462c1ae594e37e2840e85c27ea61b31c1e08efdbf6"} Sep 08 10:17:36.737329 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.737307 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"af40f5e6bbbb8d3161b2b68e711c89c558d97a76829644ddd0135a9e07880b66"} Sep 08 10:17:36.737416 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.737358 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"016e375520e5242fdb4b27cb2ec22223963effbeb540a7e4edeb7612dcfdf0e8"} Sep 08 10:17:36.737416 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.737402 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"9551719ade71c4050cdb6a6095ac61426cdf089ee80398d3dfcdff4bc2a86541"} Sep 08 10:17:36.737484 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.737431 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"a3a0859c432565f6652ff5cc856670dd4f7b180aa6166bd9fcd67317b376bd5e"} Sep 08 10:17:36.737484 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.737457 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"b70340be92a7342dd0f5c1bbd766dbaadad8e5a3fe3ca0639d2879364b2d1f6b"} Sep 08 10:17:36.737546 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.737490 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"c419733eec10487d9eec827d6a91af47908da5747e279fa60e31ca44c4ef1d18"} Sep 08 10:17:36.738874 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.738853 2532 generic.go:356] "Generic (PLEG): container finished" podID="876c61ed-2c19-45d1-b8bd-7f003c76ecbe" containerID="cebd7f75a57c4e7bbf21af358dd570f792a5d018778457bab4e480cb5d723edf" exitCode=0 Sep 08 10:17:36.738968 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.738882 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerDied","Data":"cebd7f75a57c4e7bbf21af358dd570f792a5d018778457bab4e480cb5d723edf"} Sep 08 10:17:36.740451 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.740422 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7krmk" event={"ID":"ad1d3048-607f-44b9-8939-1278844d4b7a","Type":"ContainerStarted","Data":"eb02a8bee4e30eeb4d67e2b4fcca59eb1c52b91fd31af2e5fcf12b7db6578f19"} Sep 08 10:17:36.741958 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.741937 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" event={"ID":"933214fb-4f09-4163-a330-8a1512012a8f","Type":"ContainerStarted","Data":"899e2fdea581f2874f327bb0ade26e9e0176c0dc7bd9429619db1d44088248cd"} Sep 08 10:17:36.743413 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.743393 2532 generic.go:356] "Generic (PLEG): container finished" podID="a61fe91c7cc9dcf385d8fba2652fdc44" containerID="b6d5c8bf82976972b10e52fd9729f55bd87bd8b3e307a46f93a9d83f1a44653a" exitCode=0 Sep 08 10:17:36.743499 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.743457 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" event={"ID":"a61fe91c7cc9dcf385d8fba2652fdc44","Type":"ContainerDied","Data":"b6d5c8bf82976972b10e52fd9729f55bd87bd8b3e307a46f93a9d83f1a44653a"} Sep 08 10:17:36.744882 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.744863 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ddwr4" event={"ID":"1eaa6ddb-ba08-499c-9561-fb63cffc6dc8","Type":"ContainerStarted","Data":"eb85ee72d2cc59f0ba900a9cfa7f848b0e45bffd0dc68a2efcbca8a9e3aad203"} Sep 08 10:17:36.746620 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.746599 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" event={"ID":"fe7a623c-ebea-49e4-95b4-12b6e273c368","Type":"ContainerStarted","Data":"d0be61d46bd7ad8d0a2085a21ee68cd3aef6491d0de4df4bf7f79df5c0013129"} Sep 08 10:17:36.761904 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.761866 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-85.ec2.internal" podStartSLOduration=20.761829413 podStartE2EDuration="20.761829413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:18.713408897 +0000 UTC m=+4.600118399" watchObservedRunningTime="2026-09-08 10:17:36.761829413 +0000 UTC m=+22.648538907" Sep 08 10:17:36.762461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.762426 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hl4wb" podStartSLOduration=2.6776453289999997 podStartE2EDuration="21.762415979s" totalImagesPullingTime="19.08477065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:36.761946568 +0000 UTC m=+22.648656062" watchObservedRunningTime="2026-09-08 10:17:36.762415979 +0000 UTC m=+22.649125472" Sep 08 10:17:36.810454 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.810404 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x5vlj" podStartSLOduration=6.675310711 podStartE2EDuration="21.810381554s" totalImagesPullingTime="15.135070843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:36.80984198 +0000 UTC m=+22.696551473" watchObservedRunningTime="2026-09-08 10:17:36.810381554 +0000 UTC m=+22.697091048" Sep 08 10:17:36.829543 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.829503 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tjhwb" podStartSLOduration=2.71677519 podStartE2EDuration="21.829487699s" totalImagesPullingTime="19.112712509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:36.829022125 +0000 UTC m=+22.715731637" watchObservedRunningTime="2026-09-08 10:17:36.829487699 +0000 UTC m=+22.716197191" Sep 08 10:17:36.846420 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.846382 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7krmk" podStartSLOduration=2.736575285 podStartE2EDuration="21.846367938s" totalImagesPullingTime="19.109792653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:36.846270679 +0000 UTC m=+22.732980171" watchObservedRunningTime="2026-09-08 10:17:36.846367938 +0000 UTC m=+22.733077430" Sep 08 10:17:36.864854 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:36.864816 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ddwr4" podStartSLOduration=3.064088465 podStartE2EDuration="21.864804886s" totalImagesPullingTime="18.800716421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:36.86440157 +0000 UTC m=+22.751111063" watchObservedRunningTime="2026-09-08 10:17:36.864804886 +0000 UTC m=+22.751514378" Sep 08 10:17:37.653611 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:37.653580 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:37.653611 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:37.653595 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:37.653909 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:37.653705 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:37.653909 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:37.653824 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:37.750621 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:37.750587 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tq5h9" event={"ID":"9394da66-c253-462e-a139-3ea6c54b6f20","Type":"ContainerStarted","Data":"2a81d805da7815d2cf7745e0b5e4f8e50afa719d389fb33fffc33aca68237f01"} Sep 08 10:17:37.752692 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:37.752663 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" event={"ID":"a61fe91c7cc9dcf385d8fba2652fdc44","Type":"ContainerStarted","Data":"cf547465d6edece2adc04e9f4d8170bf547963e63ea45aac150c27f465b182c3"} Sep 08 10:17:37.769030 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:37.768984 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tq5h9" podStartSLOduration=7.591510679 podStartE2EDuration="22.76897035s" totalImagesPullingTime="15.177459671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:37.768573312 +0000 UTC m=+23.655282825" watchObservedRunningTime="2026-09-08 10:17:37.76897035 +0000 UTC m=+23.655679842" Sep 08 10:17:37.786023 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:37.785981 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-85.ec2.internal" podStartSLOduration=21.785968077 podStartE2EDuration="21.785968077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:37.785912401 +0000 UTC m=+23.672621919" watchObservedRunningTime="2026-09-08 10:17:37.785968077 +0000 UTC m=+23.672677566" Sep 08 10:17:38.654594 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:38.654083 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:38.654594 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:38.654244 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:38.760500 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:38.759787 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"0876e212201359729ff752787d2776067d11cebde032e42a5bde2dc512d3e8b1"} Sep 08 10:17:39.190437 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.190415 2532 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 10:17:39.627005 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.626855 2532 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T10:17:39.190433618Z","UUID":"fba96a4b-cb05-4d0a-80d1-7bd2344d91d3","Handler":null,"Name":"","Endpoint":""} Sep 08 10:17:39.628476 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.628449 2532 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 10:17:39.628590 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.628489 2532 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 10:17:39.653837 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.653813 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:39.653968 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:39.653929 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:39.654011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.653979 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:39.654086 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:39.654070 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:39.764839 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:39.764798 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" event={"ID":"fe7a623c-ebea-49e4-95b4-12b6e273c368","Type":"ContainerStarted","Data":"3a48cdf0efaf5e088fbd614a5b2ac19c6a6594c0b88e3a33e3a1244f70ca6c8a"} Sep 08 10:17:40.657226 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:40.657198 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:40.657436 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:40.657335 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:40.931013 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:40.930923 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:40.931677 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:40.931652 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:41.654586 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.654369 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:41.654586 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.654386 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:41.654837 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:41.654703 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:41.654837 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:41.654804 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:41.772999 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.772961 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" event={"ID":"c6a9cfea-072a-4702-8736-7157612f501a","Type":"ContainerStarted","Data":"0d41003d98ed3872707dfde664a9c589836c2d08c158ccabceda5a1a23127cc0"} Sep 08 10:17:41.773278 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.773257 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:41.773458 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.773331 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:41.775009 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.774985 2532 generic.go:356] "Generic (PLEG): container finished" podID="876c61ed-2c19-45d1-b8bd-7f003c76ecbe" containerID="34d66d154d8eb2e468109611e0150b1107307e6381a6e27eb7019903414499a6" exitCode=0 Sep 08 10:17:41.775117 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.775079 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerDied","Data":"34d66d154d8eb2e468109611e0150b1107307e6381a6e27eb7019903414499a6"} Sep 08 10:17:41.789048 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.789028 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:41.806170 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:41.806113 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" podStartSLOduration=7.669477964 podStartE2EDuration="26.806100903s" totalImagesPullingTime="19.136622939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:41.805874468 +0000 UTC m=+27.692583985" watchObservedRunningTime="2026-09-08 10:17:41.806100903 +0000 UTC m=+27.692810396" Sep 08 10:17:42.044368 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.044342 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:42.045385 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.045339 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ddwr4" Sep 08 10:17:42.653467 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.653413 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:42.657474 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:42.653898 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:42.780806 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.780767 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" event={"ID":"fe7a623c-ebea-49e4-95b4-12b6e273c368","Type":"ContainerStarted","Data":"43aef0adc1cb5ec90e0f4a92ba0fc028fbd14dbdcd56a0c3ff39ac30dc2f54b3"} Sep 08 10:17:42.783761 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.783728 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerStarted","Data":"e9300659f69fb981bc9c7a2b0e39bc66c0e9cc22268b2d2a761962ea12424753"} Sep 08 10:17:42.784527 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.784503 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:42.801156 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.801115 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:17:42.833322 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:42.833094 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6f65l" podStartSLOduration=3.323718181 podStartE2EDuration="27.833075977s" totalImagesPullingTime="24.509357796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:42.803021911 +0000 UTC m=+28.689731427" watchObservedRunningTime="2026-09-08 10:17:42.833075977 +0000 UTC m=+28.719785469" Sep 08 10:17:43.061272 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.061243 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2b2ct"] Sep 08 10:17:43.061815 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.061380 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:43.061815 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:43.061500 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:43.064267 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.064115 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b86ls"] Sep 08 10:17:43.064267 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.064248 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:43.064440 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:43.064346 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:43.064768 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.064748 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlbmt"] Sep 08 10:17:43.064846 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.064834 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:43.064923 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:43.064909 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:43.788806 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.788707 2532 generic.go:356] "Generic (PLEG): container finished" podID="876c61ed-2c19-45d1-b8bd-7f003c76ecbe" containerID="e9300659f69fb981bc9c7a2b0e39bc66c0e9cc22268b2d2a761962ea12424753" exitCode=0 Sep 08 10:17:43.788806 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.788733 2532 generic.go:356] "Generic (PLEG): container finished" podID="876c61ed-2c19-45d1-b8bd-7f003c76ecbe" containerID="4bc5b4482384039418c9dd8fb991122ef616889565cc87cf90a9e276d9cafe01" exitCode=0 Sep 08 10:17:43.788975 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.788819 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerDied","Data":"e9300659f69fb981bc9c7a2b0e39bc66c0e9cc22268b2d2a761962ea12424753"} Sep 08 10:17:43.788975 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:43.788873 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerDied","Data":"4bc5b4482384039418c9dd8fb991122ef616889565cc87cf90a9e276d9cafe01"} Sep 08 10:17:44.654907 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:44.654875 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:44.655380 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:44.654972 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:44.655380 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:44.655023 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:44.655380 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:44.655079 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:44.655502 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:44.655385 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:44.655502 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:44.655451 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:45.165587 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:45.165544 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:45.262309 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:45.262270 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:45.366849 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:45.366809 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:46.653641 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:46.653598 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:46.654158 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:46.653646 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:46.654158 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:46.653657 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:46.654158 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:46.653771 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:46.654158 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:46.653893 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:46.654158 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:46.653956 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:46.952617 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:46.952544 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:47.021232 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:47.021187 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:48.290338 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.290305 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:48.290765 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.290450 2532 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:48.290765 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.290510 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret podName:0fa45e7d-f861-4a82-9355-62781f6cf75b nodeName:}" failed. No retries permitted until 2026-09-08 10:18:20.290494604 +0000 UTC m=+66.177204075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret") pod "global-pull-secret-syncer-2b2ct" (UID: "0fa45e7d-f861-4a82-9355-62781f6cf75b") : object "kube-system"/"original-pull-secret" not registered Sep 08 10:17:48.391241 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.391217 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:48.391332 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.391264 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:48.391393 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.391377 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:48.391393 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.391388 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 10:17:48.391455 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.391407 2532 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 10:17:48.391455 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.391419 2532 projected.go:196] Error preparing data for projected volume kube-api-access-dfks5 for pod openshift-network-diagnostics/network-check-target-b86ls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:48.391455 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.391442 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:18:20.39142402 +0000 UTC m=+66.278133515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 10:17:48.391552 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.391470 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5 podName:5d373d64-68cb-4acf-aaa2-b32ab5cdf64c nodeName:}" failed. No retries permitted until 2026-09-08 10:18:20.39145911 +0000 UTC m=+66.278168596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dfks5" (UniqueName: "kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5") pod "network-check-target-b86ls" (UID: "5d373d64-68cb-4acf-aaa2-b32ab5cdf64c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 10:17:48.654638 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.654395 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:48.654742 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.654393 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:48.654784 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.654750 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2b2ct" podUID="0fa45e7d-f861-4a82-9355-62781f6cf75b" Sep 08 10:17:48.654784 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.654431 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:48.654858 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.654796 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlbmt" podUID="7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec" Sep 08 10:17:48.654858 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:48.654849 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b86ls" podUID="5d373d64-68cb-4acf-aaa2-b32ab5cdf64c" Sep 08 10:17:48.804735 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.804702 2532 generic.go:356] "Generic (PLEG): container finished" podID="876c61ed-2c19-45d1-b8bd-7f003c76ecbe" containerID="6a570f8c72ed85a32928593b1bacd7e4e167baa65f0f2640980ea2c920f78c9f" exitCode=0 Sep 08 10:17:48.804893 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.804751 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerDied","Data":"6a570f8c72ed85a32928593b1bacd7e4e167baa65f0f2640980ea2c920f78c9f"} Sep 08 10:17:48.878929 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.878908 2532 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-85.ec2.internal" event="NodeReady" Sep 08 10:17:48.879056 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.879046 2532 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 10:17:48.932498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.932472 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qwnl9"] Sep 08 10:17:48.949596 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.949569 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jcwz5"] Sep 08 10:17:48.949869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.949852 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:48.952549 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.952528 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 10:17:48.952770 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.952757 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7bmn\"" Sep 08 10:17:48.953055 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.953038 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 10:17:48.966848 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.966821 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qwnl9"] Sep 08 10:17:48.966952 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.966914 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:48.966952 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.966924 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jcwz5"] Sep 08 10:17:48.969787 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.969756 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 10:17:48.969908 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.969812 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9klnr\"" Sep 08 10:17:48.969908 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.969853 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 10:17:48.969908 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:48.969864 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 10:17:49.096414 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.096381 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbf9p\" (UniqueName: \"kubernetes.io/projected/b931dbcf-c9bd-4252-a1f0-c7639936ca5f-kube-api-access-vbf9p\") pod \"ingress-canary-jcwz5\" (UID: \"b931dbcf-c9bd-4252-a1f0-c7639936ca5f\") " pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.096414 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.096423 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e09965ad-afe0-48da-98ee-e47d127c704e-config-volume\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.096626 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.096445 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b931dbcf-c9bd-4252-a1f0-c7639936ca5f-cert\") pod \"ingress-canary-jcwz5\" (UID: \"b931dbcf-c9bd-4252-a1f0-c7639936ca5f\") " pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.096626 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.096463 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2f7g\" (UniqueName: \"kubernetes.io/projected/e09965ad-afe0-48da-98ee-e47d127c704e-kube-api-access-p2f7g\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.096626 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.096518 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09965ad-afe0-48da-98ee-e47d127c704e-tmp-dir\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.096626 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.096560 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.197714 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.197623 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b931dbcf-c9bd-4252-a1f0-c7639936ca5f-cert\") pod \"ingress-canary-jcwz5\" (UID: \"b931dbcf-c9bd-4252-a1f0-c7639936ca5f\") " pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.197714 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.197668 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2f7g\" (UniqueName: \"kubernetes.io/projected/e09965ad-afe0-48da-98ee-e47d127c704e-kube-api-access-p2f7g\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.197921 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.197746 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09965ad-afe0-48da-98ee-e47d127c704e-tmp-dir\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.197921 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.197796 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.197921 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.197834 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbf9p\" (UniqueName: \"kubernetes.io/projected/b931dbcf-c9bd-4252-a1f0-c7639936ca5f-kube-api-access-vbf9p\") pod \"ingress-canary-jcwz5\" (UID: \"b931dbcf-c9bd-4252-a1f0-c7639936ca5f\") " pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.197921 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.197865 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e09965ad-afe0-48da-98ee-e47d127c704e-config-volume\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.197921 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:49.197916 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:17:49.198273 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:49.197987 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:17:49.697966802 +0000 UTC m=+35.584676295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:17:49.198336 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.198269 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09965ad-afe0-48da-98ee-e47d127c704e-tmp-dir\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.198477 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.198457 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e09965ad-afe0-48da-98ee-e47d127c704e-config-volume\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.202296 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.202274 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b931dbcf-c9bd-4252-a1f0-c7639936ca5f-cert\") pod \"ingress-canary-jcwz5\" (UID: \"b931dbcf-c9bd-4252-a1f0-c7639936ca5f\") " pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.209988 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.209967 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbf9p\" (UniqueName: \"kubernetes.io/projected/b931dbcf-c9bd-4252-a1f0-c7639936ca5f-kube-api-access-vbf9p\") pod \"ingress-canary-jcwz5\" (UID: \"b931dbcf-c9bd-4252-a1f0-c7639936ca5f\") " pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.210296 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.210276 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2f7g\" (UniqueName: \"kubernetes.io/projected/e09965ad-afe0-48da-98ee-e47d127c704e-kube-api-access-p2f7g\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.277412 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.277387 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jcwz5" Sep 08 10:17:49.514831 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.514746 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:49.607439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.607411 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jcwz5"] Sep 08 10:17:49.611438 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:17:49.611411 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb931dbcf_c9bd_4252_a1f0_c7639936ca5f.slice/crio-a1240fc370cf1e2a9cb59d4c52b405576c81af64f62feecf81bc632a1323e517 WatchSource:0}: Error finding container a1240fc370cf1e2a9cb59d4c52b405576c81af64f62feecf81bc632a1323e517: Status 404 returned error can't find the container with id a1240fc370cf1e2a9cb59d4c52b405576c81af64f62feecf81bc632a1323e517 Sep 08 10:17:49.612810 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.612777 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:49.697625 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.697594 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:49.700951 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.700932 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:49.701091 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:49.701074 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:17:49.701167 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:49.701156 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:17:50.701121072 +0000 UTC m=+36.587830548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:17:49.808474 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.808384 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jcwz5" event={"ID":"b931dbcf-c9bd-4252-a1f0-c7639936ca5f","Type":"ContainerStarted","Data":"a1240fc370cf1e2a9cb59d4c52b405576c81af64f62feecf81bc632a1323e517"} Sep 08 10:17:49.811513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.811488 2532 generic.go:356] "Generic (PLEG): container finished" podID="876c61ed-2c19-45d1-b8bd-7f003c76ecbe" containerID="4dc37d3045ff22afe15a22b91fbe6e1cf4bb888e415804017b92757f173cf333" exitCode=0 Sep 08 10:17:49.811625 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:49.811524 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerDied","Data":"4dc37d3045ff22afe15a22b91fbe6e1cf4bb888e415804017b92757f173cf333"} Sep 08 10:17:50.654114 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.653853 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:17:50.654572 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.653859 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:17:50.654795 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.653887 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:17:50.658047 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.658024 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 10:17:50.658187 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.658104 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 10:17:50.659050 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.659025 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 10:17:50.659171 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.659086 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2btxr\"" Sep 08 10:17:50.659171 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.659091 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljzsh\"" Sep 08 10:17:50.659301 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.659031 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 10:17:50.689212 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.689179 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:50.708236 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.708208 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:50.708400 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:50.708385 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:17:50.708462 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:50.708451 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:17:52.708436632 +0000 UTC m=+38.595146108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:17:50.786308 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.786270 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:50.818266 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.818236 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" event={"ID":"876c61ed-2c19-45d1-b8bd-7f003c76ecbe","Type":"ContainerStarted","Data":"f21612dd0e79b406510b10519ace98b315b2b50c2d2e975a6f7ba438bf2040e8"} Sep 08 10:17:50.853059 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.852431 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vw7fl" podStartSLOduration=6.453503106 podStartE2EDuration="35.852409019s" totalImagesPullingTime="29.398905913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:50.852290218 +0000 UTC m=+36.738999726" watchObservedRunningTime="2026-09-08 10:17:50.852409019 +0000 UTC m=+36.739118513" Sep 08 10:17:50.987535 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:50.987446 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:51.065556 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:51.065528 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:52.726639 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:52.726595 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:52.726993 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:52.726741 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:17:52.726993 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:52.726801 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:17:56.726787353 +0000 UTC m=+42.613496824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:17:52.824800 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:52.824768 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jcwz5" event={"ID":"b931dbcf-c9bd-4252-a1f0-c7639936ca5f","Type":"ContainerStarted","Data":"414849fc9aa27342cd946d79e7a507b9593c4bd75250887fba88fa372dfbd9a0"} Sep 08 10:17:52.848665 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:52.848569 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jcwz5" podStartSLOduration=2.144050431 podStartE2EDuration="4.848552681s" totalImagesPullingTime="2.70450225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:52.84786913 +0000 UTC m=+38.734578642" watchObservedRunningTime="2026-09-08 10:17:52.848552681 +0000 UTC m=+38.735262173" Sep 08 10:17:53.077753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:53.077718 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:53.159071 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:53.159043 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:54.235445 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:54.235415 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:54.796550 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:54.796510 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:54.898535 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:54.898502 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:56.754680 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:56.754635 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:17:56.755048 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:56.754794 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:17:56.755048 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:17:56.754864 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:18:04.754845918 +0000 UTC m=+50.641555410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:17:59.654081 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:59.654043 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:17:59.728163 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:17:59.728104 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:04.808338 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:04.808295 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:18:04.808741 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:04.808447 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:18:04.808741 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:04.808516 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:18:20.808498829 +0000 UTC m=+66.695208300 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:18:07.485454 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:07.485419 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:07.569399 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:07.569366 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:07.996482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:07.996449 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7"] Sep 08 10:18:07.998110 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:07.998095 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.000823 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.000800 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:18:08.001175 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.001154 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 08 10:18:08.001263 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.001167 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 08 10:18:08.002008 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.001994 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-56cxb\"" Sep 08 10:18:08.023217 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.023198 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7"] Sep 08 10:18:08.093656 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.093625 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hb4kc"] Sep 08 10:18:08.096509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.096485 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" Sep 08 10:18:08.100122 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.100100 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k92vh\"" Sep 08 10:18:08.105318 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.105301 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-m8r6n"] Sep 08 10:18:08.106732 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.106718 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.114810 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.114793 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 08 10:18:08.115086 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.115069 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 10:18:08.115188 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.115111 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 10:18:08.115332 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.115319 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 08 10:18:08.115573 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.115559 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bcq9d\"" Sep 08 10:18:08.117996 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.117974 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hb4kc"] Sep 08 10:18:08.127501 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.127478 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 08 10:18:08.131564 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.131545 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhclm\" (UniqueName: \"kubernetes.io/projected/c7ba089c-b99f-48f3-a4ee-83b4d546741d-kube-api-access-qhclm\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.131610 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.131589 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.137394 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.137376 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-m8r6n"] Sep 08 10:18:08.207795 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.207764 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9"] Sep 08 10:18:08.209530 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.209515 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.215991 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.215965 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 08 10:18:08.216089 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.216006 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sws8w\"" Sep 08 10:18:08.222028 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.222011 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 08 10:18:08.222154 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.222051 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 08 10:18:08.222314 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.222299 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 08 10:18:08.232517 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232495 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0e5afe-33be-434d-8625-9d93104d489e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.232585 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232529 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhclm\" (UniqueName: \"kubernetes.io/projected/c7ba089c-b99f-48f3-a4ee-83b4d546741d-kube-api-access-qhclm\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.232585 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232568 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.232650 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:08.232643 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:18:08.232703 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:08.232693 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls podName:c7ba089c-b99f-48f3-a4ee-83b4d546741d nodeName:}" failed. No retries permitted until 2026-09-08 10:18:08.73268061 +0000 UTC m=+54.619390093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dc9m7" (UID: "c7ba089c-b99f-48f3-a4ee-83b4d546741d") : secret "samples-operator-tls" not found Sep 08 10:18:08.232744 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232720 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0e5afe-33be-434d-8625-9d93104d489e-serving-cert\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.232776 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232749 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb0e5afe-33be-434d-8625-9d93104d489e-snapshots\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.232814 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232780 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0e5afe-33be-434d-8625-9d93104d489e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.232849 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232837 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb0e5afe-33be-434d-8625-9d93104d489e-tmp\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.232881 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232871 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56dst\" (UniqueName: \"kubernetes.io/projected/eb0e5afe-33be-434d-8625-9d93104d489e-kube-api-access-56dst\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.232915 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.232889 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-459fj\" (UniqueName: \"kubernetes.io/projected/aed072c9-cb84-4344-861f-461f449e1fe1-kube-api-access-459fj\") pod \"network-check-source-685456655f-hb4kc\" (UID: \"aed072c9-cb84-4344-861f-461f449e1fe1\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" Sep 08 10:18:08.242593 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.242570 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9"] Sep 08 10:18:08.272549 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.272483 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhclm\" (UniqueName: \"kubernetes.io/projected/c7ba089c-b99f-48f3-a4ee-83b4d546741d-kube-api-access-qhclm\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.333498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333471 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0e5afe-33be-434d-8625-9d93104d489e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.333645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333503 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-serving-cert\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.333645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333533 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8c6h\" (UniqueName: \"kubernetes.io/projected/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-kube-api-access-q8c6h\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.333645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333597 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0e5afe-33be-434d-8625-9d93104d489e-serving-cert\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.333645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333618 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-config\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.333645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333638 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb0e5afe-33be-434d-8625-9d93104d489e-snapshots\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.333888 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333668 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0e5afe-33be-434d-8625-9d93104d489e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.333888 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333716 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb0e5afe-33be-434d-8625-9d93104d489e-tmp\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.333888 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333740 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56dst\" (UniqueName: \"kubernetes.io/projected/eb0e5afe-33be-434d-8625-9d93104d489e-kube-api-access-56dst\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.334014 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.333885 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-459fj\" (UniqueName: \"kubernetes.io/projected/aed072c9-cb84-4344-861f-461f449e1fe1-kube-api-access-459fj\") pod \"network-check-source-685456655f-hb4kc\" (UID: \"aed072c9-cb84-4344-861f-461f449e1fe1\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" Sep 08 10:18:08.334173 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.334131 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0e5afe-33be-434d-8625-9d93104d489e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.334247 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.334222 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb0e5afe-33be-434d-8625-9d93104d489e-tmp\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.334298 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.334277 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eb0e5afe-33be-434d-8625-9d93104d489e-snapshots\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.334439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.334422 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb0e5afe-33be-434d-8625-9d93104d489e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.336009 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.335991 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb0e5afe-33be-434d-8625-9d93104d489e-serving-cert\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.350907 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.350880 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56dst\" (UniqueName: \"kubernetes.io/projected/eb0e5afe-33be-434d-8625-9d93104d489e-kube-api-access-56dst\") pod \"insights-operator-76bcd6ccf5-m8r6n\" (UID: \"eb0e5afe-33be-434d-8625-9d93104d489e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.356192 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.356174 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-459fj\" (UniqueName: \"kubernetes.io/projected/aed072c9-cb84-4344-861f-461f449e1fe1-kube-api-access-459fj\") pod \"network-check-source-685456655f-hb4kc\" (UID: \"aed072c9-cb84-4344-861f-461f449e1fe1\") " pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" Sep 08 10:18:08.405386 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.405351 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" Sep 08 10:18:08.413867 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.413848 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" Sep 08 10:18:08.429152 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.429103 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:08.435043 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.435013 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-serving-cert\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.435178 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.435056 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8c6h\" (UniqueName: \"kubernetes.io/projected/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-kube-api-access-q8c6h\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.435238 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.435199 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-config\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.435807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.435784 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-config\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.437258 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.437241 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-serving-cert\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.463694 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.462634 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8c6h\" (UniqueName: \"kubernetes.io/projected/9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8-kube-api-access-q8c6h\") pod \"service-ca-operator-859f94c4b-pbcp9\" (UID: \"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.518276 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.518243 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" Sep 08 10:18:08.528573 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.528544 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:08.688824 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.688788 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-hb4kc"] Sep 08 10:18:08.692210 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:08.692181 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed072c9_cb84_4344_861f_461f449e1fe1.slice/crio-b7388fbeb20427cdfb178a086e77a5c4abf05251be57868af027778f6ce7d8b4 WatchSource:0}: Error finding container b7388fbeb20427cdfb178a086e77a5c4abf05251be57868af027778f6ce7d8b4: Status 404 returned error can't find the container with id b7388fbeb20427cdfb178a086e77a5c4abf05251be57868af027778f6ce7d8b4 Sep 08 10:18:08.699839 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.699815 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-m8r6n"] Sep 08 10:18:08.702528 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:08.702510 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0e5afe_33be_434d_8625_9d93104d489e.slice/crio-faf217cad079aa747dae46d662179a17ebb28b358548e05c311d2992757d9380 WatchSource:0}: Error finding container faf217cad079aa747dae46d662179a17ebb28b358548e05c311d2992757d9380: Status 404 returned error can't find the container with id faf217cad079aa747dae46d662179a17ebb28b358548e05c311d2992757d9380 Sep 08 10:18:08.738961 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.738939 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:08.739058 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:08.739032 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:18:08.739097 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:08.739075 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls podName:c7ba089c-b99f-48f3-a4ee-83b4d546741d nodeName:}" failed. No retries permitted until 2026-09-08 10:18:09.739062016 +0000 UTC m=+55.625771486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dc9m7" (UID: "c7ba089c-b99f-48f3-a4ee-83b4d546741d") : secret "samples-operator-tls" not found Sep 08 10:18:08.805009 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.804941 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9"] Sep 08 10:18:08.807877 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:08.807853 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab4b2a2_b23e_48b7_a4fb_e971e66f5fc8.slice/crio-a13fcc5d3bfac9a9637c6a37c4e9e0162cc77346da36bc333c3c32c974714cf6 WatchSource:0}: Error finding container a13fcc5d3bfac9a9637c6a37c4e9e0162cc77346da36bc333c3c32c974714cf6: Status 404 returned error can't find the container with id a13fcc5d3bfac9a9637c6a37c4e9e0162cc77346da36bc333c3c32c974714cf6 Sep 08 10:18:08.866312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.866273 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" event={"ID":"aed072c9-cb84-4344-861f-461f449e1fe1","Type":"ContainerStarted","Data":"b7388fbeb20427cdfb178a086e77a5c4abf05251be57868af027778f6ce7d8b4"} Sep 08 10:18:08.867392 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.867366 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" event={"ID":"eb0e5afe-33be-434d-8625-9d93104d489e","Type":"ContainerStarted","Data":"faf217cad079aa747dae46d662179a17ebb28b358548e05c311d2992757d9380"} Sep 08 10:18:08.868443 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:08.868414 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" event={"ID":"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8","Type":"ContainerStarted","Data":"a13fcc5d3bfac9a9637c6a37c4e9e0162cc77346da36bc333c3c32c974714cf6"} Sep 08 10:18:09.746512 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:09.746470 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:09.746967 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:09.746666 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:18:09.746967 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:09.746748 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls podName:c7ba089c-b99f-48f3-a4ee-83b4d546741d nodeName:}" failed. No retries permitted until 2026-09-08 10:18:11.746726853 +0000 UTC m=+57.633436341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dc9m7" (UID: "c7ba089c-b99f-48f3-a4ee-83b4d546741d") : secret "samples-operator-tls" not found Sep 08 10:18:10.697883 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:10.697841 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:11.762670 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:11.762625 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:11.763084 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:11.762752 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:18:11.763084 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:11.762816 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls podName:c7ba089c-b99f-48f3-a4ee-83b4d546741d nodeName:}" failed. No retries permitted until 2026-09-08 10:18:15.762802193 +0000 UTC m=+61.649511677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dc9m7" (UID: "c7ba089c-b99f-48f3-a4ee-83b4d546741d") : secret "samples-operator-tls" not found Sep 08 10:18:11.877383 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:11.877346 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" event={"ID":"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8","Type":"ContainerStarted","Data":"09242d177e3ecdd624572a3b21aed2b46f9353e62921d2ad59a28eeba86d2d59"} Sep 08 10:18:11.899722 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:11.899672 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" podStartSLOduration=1.925304267 podStartE2EDuration="3.899657282s" totalImagesPullingTime="1.974353015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:11.899412384 +0000 UTC m=+57.786121896" watchObservedRunningTime="2026-09-08 10:18:11.899657282 +0000 UTC m=+57.786366768" Sep 08 10:18:12.714060 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:12.714024 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:12.808262 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:12.808229 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:13.607264 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.607235 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs"] Sep 08 10:18:13.609312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.609293 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" Sep 08 10:18:13.611984 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.611960 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 08 10:18:13.612094 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.611960 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 08 10:18:13.612094 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.611962 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-skp28\"" Sep 08 10:18:13.624225 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.624115 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs"] Sep 08 10:18:13.649936 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.649909 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:13.725305 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.725273 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:13.782741 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.782709 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9s4g\" (UniqueName: \"kubernetes.io/projected/f1b46302-b131-4810-a2ae-1eb802925e24-kube-api-access-c9s4g\") pod \"migrator-fdbb8fdff-bdbcs\" (UID: \"f1b46302-b131-4810-a2ae-1eb802925e24\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" Sep 08 10:18:13.883245 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.883154 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9s4g\" (UniqueName: \"kubernetes.io/projected/f1b46302-b131-4810-a2ae-1eb802925e24-kube-api-access-c9s4g\") pod \"migrator-fdbb8fdff-bdbcs\" (UID: \"f1b46302-b131-4810-a2ae-1eb802925e24\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" Sep 08 10:18:13.884691 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.884665 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" event={"ID":"eb0e5afe-33be-434d-8625-9d93104d489e","Type":"ContainerStarted","Data":"ee9f68e9473338b518af5683f5954f0cf0c28fbe9071025372fd37c44bdff9c4"} Sep 08 10:18:13.894286 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.894259 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9s4g\" (UniqueName: \"kubernetes.io/projected/f1b46302-b131-4810-a2ae-1eb802925e24-kube-api-access-c9s4g\") pod \"migrator-fdbb8fdff-bdbcs\" (UID: \"f1b46302-b131-4810-a2ae-1eb802925e24\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" Sep 08 10:18:13.906354 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.906303 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" podStartSLOduration=0.983106737 podStartE2EDuration="5.906284458s" totalImagesPullingTime="4.923177721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:13.906223966 +0000 UTC m=+59.792933479" watchObservedRunningTime="2026-09-08 10:18:13.906284458 +0000 UTC m=+59.792993950" Sep 08 10:18:13.920331 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:13.920304 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" Sep 08 10:18:14.400189 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.400153 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:14.506099 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.506026 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:14.811328 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.811300 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qhqt2" Sep 08 10:18:14.821601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.821572 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wjwk5"] Sep 08 10:18:14.824877 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.824092 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:14.827446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.827426 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 10:18:14.827643 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.827426 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 10:18:14.827643 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.827558 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2wq7c\"" Sep 08 10:18:14.840822 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.840797 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjwk5"] Sep 08 10:18:14.847283 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.847262 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:14.892524 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.892177 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" event={"ID":"aed072c9-cb84-4344-861f-461f449e1fe1","Type":"ContainerStarted","Data":"2369552c057cb121fb0dca5d9d578a18bc69d9df5a36eca4173a3121d44a5d7a"} Sep 08 10:18:14.917637 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.917589 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-hb4kc" podStartSLOduration=0.843490784 podStartE2EDuration="6.917574664s" totalImagesPullingTime="6.07408388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:14.917089677 +0000 UTC m=+60.803799187" watchObservedRunningTime="2026-09-08 10:18:14.917574664 +0000 UTC m=+60.804284151" Sep 08 10:18:14.943930 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.943901 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:14.999457 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.999379 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:14.999457 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.999419 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc6m8\" (UniqueName: \"kubernetes.io/projected/3699ff39-87cb-4703-a118-b18579397bc6-kube-api-access-kc6m8\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:14.999457 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.999444 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3699ff39-87cb-4703-a118-b18579397bc6-data-volume\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:14.999719 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.999625 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3699ff39-87cb-4703-a118-b18579397bc6-crio-socket\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:14.999719 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:14.999683 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.026849 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.026815 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs"] Sep 08 10:18:15.031773 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:15.031746 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b46302_b131_4810_a2ae_1eb802925e24.slice/crio-e140415b337b766c4b9261ac49ded4b81ba48217c3a08aff2f188085363748e7 WatchSource:0}: Error finding container e140415b337b766c4b9261ac49ded4b81ba48217c3a08aff2f188085363748e7: Status 404 returned error can't find the container with id e140415b337b766c4b9261ac49ded4b81ba48217c3a08aff2f188085363748e7 Sep 08 10:18:15.035800 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.035780 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:15.101403 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101370 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.101403 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101407 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc6m8\" (UniqueName: \"kubernetes.io/projected/3699ff39-87cb-4703-a118-b18579397bc6-kube-api-access-kc6m8\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.101594 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101433 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3699ff39-87cb-4703-a118-b18579397bc6-data-volume\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.101594 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101470 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3699ff39-87cb-4703-a118-b18579397bc6-crio-socket\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.101594 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101499 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.101594 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.101520 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:18:15.101759 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.101600 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:15.601581096 +0000 UTC m=+61.488290573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : configmap "kube-rbac-proxy" not found Sep 08 10:18:15.101759 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.101608 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:18:15.101759 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101626 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3699ff39-87cb-4703-a118-b18579397bc6-crio-socket\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.101759 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.101660 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:15.601645226 +0000 UTC m=+61.488354724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : secret "insights-runtime-extractor-tls" not found Sep 08 10:18:15.101913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.101805 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3699ff39-87cb-4703-a118-b18579397bc6-data-volume\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.111845 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.111810 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc6m8\" (UniqueName: \"kubernetes.io/projected/3699ff39-87cb-4703-a118-b18579397bc6-kube-api-access-kc6m8\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.135037 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.135013 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:15.606439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.606371 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.606645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.606484 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:15.606645 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.606520 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:18:15.606645 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.606596 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:16.606575235 +0000 UTC m=+62.493284731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : configmap "kube-rbac-proxy" not found Sep 08 10:18:15.606818 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.606649 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:18:15.606818 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.606733 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:16.606714729 +0000 UTC m=+62.493424217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : secret "insights-runtime-extractor-tls" not found Sep 08 10:18:15.807971 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.807932 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:15.808189 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.808117 2532 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 10:18:15.808259 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:15.808211 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls podName:c7ba089c-b99f-48f3-a4ee-83b4d546741d nodeName:}" failed. No retries permitted until 2026-09-08 10:18:23.808189189 +0000 UTC m=+69.694898677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-dc9m7" (UID: "c7ba089c-b99f-48f3-a4ee-83b4d546741d") : secret "samples-operator-tls" not found Sep 08 10:18:15.896338 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:15.896244 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" event={"ID":"f1b46302-b131-4810-a2ae-1eb802925e24","Type":"ContainerStarted","Data":"e140415b337b766c4b9261ac49ded4b81ba48217c3a08aff2f188085363748e7"} Sep 08 10:18:16.399525 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:16.399495 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:16.615062 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:16.615013 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:16.615272 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:16.615082 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:16.615272 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:16.615186 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:18:16.615272 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:16.615202 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:18:16.615272 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:16.615266 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:18.615246095 +0000 UTC m=+64.501955580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : configmap "kube-rbac-proxy" not found Sep 08 10:18:16.615433 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:16.615287 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:18.615277956 +0000 UTC m=+64.501987459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : secret "insights-runtime-extractor-tls" not found Sep 08 10:18:16.901472 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:16.901432 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" event={"ID":"f1b46302-b131-4810-a2ae-1eb802925e24","Type":"ContainerStarted","Data":"f89f25d963080253a24c3fdb8c0ee825718476821cabd9ba7ab3eebc5ddbe75d"} Sep 08 10:18:16.901854 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:16.901494 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" event={"ID":"f1b46302-b131-4810-a2ae-1eb802925e24","Type":"ContainerStarted","Data":"5bd3d79fa5959a47c76620881c75d5bd399a235ae712fb3170fa7b7f2816b121"} Sep 08 10:18:16.923454 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:16.923412 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-bdbcs" podStartSLOduration=2.569808648 podStartE2EDuration="3.923394392s" totalImagesPullingTime="1.353585744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:16.923262051 +0000 UTC m=+62.809971545" watchObservedRunningTime="2026-09-08 10:18:16.923394392 +0000 UTC m=+62.810103889" Sep 08 10:18:17.482587 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:17.482559 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7krmk_ad1d3048-607f-44b9-8939-1278844d4b7a/dns-node-resolver/0.log" Sep 08 10:18:17.902700 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:17.902667 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:18.163764 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:18.163687 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:18.630302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:18.630209 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:18.630480 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:18.630309 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:18.630480 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:18.630342 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:18:18.630480 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:18.630424 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:22.630403652 +0000 UTC m=+68.517113143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : configmap "kube-rbac-proxy" not found Sep 08 10:18:18.630480 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:18.630466 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:18:18.630644 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:18.630521 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:22.630507593 +0000 UTC m=+68.517217067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : secret "insights-runtime-extractor-tls" not found Sep 08 10:18:18.682960 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:18.682936 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x5vlj_42116614-b54c-4c7a-b55b-76b573209685/node-ca/0.log" Sep 08 10:18:19.283088 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:19.283060 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jcwz5_b931dbcf-c9bd-4252-a1f0-c7639936ca5f/serve-healthcheck-canary/0.log" Sep 08 10:18:19.693364 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:19.693334 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-bdbcs_f1b46302-b131-4810-a2ae-1eb802925e24/migrator/0.log" Sep 08 10:18:19.885654 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:19.885626 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-bdbcs_f1b46302-b131-4810-a2ae-1eb802925e24/graceful-termination/0.log" Sep 08 10:18:20.343498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.343460 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:18:20.345973 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.345954 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 10:18:20.356251 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.356218 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa45e7d-f861-4a82-9355-62781f6cf75b-original-pull-secret\") pod \"global-pull-secret-syncer-2b2ct\" (UID: \"0fa45e7d-f861-4a82-9355-62781f6cf75b\") " pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:18:20.372375 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.372349 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2b2ct" Sep 08 10:18:20.426412 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.426384 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:20.444623 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.444592 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:18:20.444746 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.444654 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:18:20.447348 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.447327 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 10:18:20.447590 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.447567 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfks5\" (UniqueName: \"kubernetes.io/projected/5d373d64-68cb-4acf-aaa2-b32ab5cdf64c-kube-api-access-dfks5\") pod \"network-check-target-b86ls\" (UID: \"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c\") " pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:18:20.455582 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:20.455562 2532 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 10:18:20.455667 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:20.455620 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs podName:7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec nodeName:}" failed. No retries permitted until 2026-09-08 10:19:24.455604737 +0000 UTC m=+130.342314211 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs") pod "network-metrics-daemon-rlbmt" (UID: "7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec") : secret "metrics-daemon-secret" not found Sep 08 10:18:20.527861 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.527834 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:20.638459 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.638383 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:20.657809 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.657790 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2b2ct"] Sep 08 10:18:20.660117 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:20.660095 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa45e7d_f861_4a82_9355_62781f6cf75b.slice/crio-a31a36b55b5d17d7a09f57a6e6b242e66e344e8daa362f2b44ffd26dc95ea2e1 WatchSource:0}: Error finding container a31a36b55b5d17d7a09f57a6e6b242e66e344e8daa362f2b44ffd26dc95ea2e1: Status 404 returned error can't find the container with id a31a36b55b5d17d7a09f57a6e6b242e66e344e8daa362f2b44ffd26dc95ea2e1 Sep 08 10:18:20.683366 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.683341 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2btxr\"" Sep 08 10:18:20.690148 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.690125 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:18:20.789924 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.789891 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:20.848032 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.847988 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:18:20.848208 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:20.848129 2532 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 10:18:20.848258 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:20.848210 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls podName:e09965ad-afe0-48da-98ee-e47d127c704e nodeName:}" failed. No retries permitted until 2026-09-08 10:18:52.848194116 +0000 UTC m=+98.734903590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls") pod "dns-default-qwnl9" (UID: "e09965ad-afe0-48da-98ee-e47d127c704e") : secret "dns-default-metrics-tls" not found Sep 08 10:18:20.915102 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.915069 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2b2ct" event={"ID":"0fa45e7d-f861-4a82-9355-62781f6cf75b","Type":"ContainerStarted","Data":"a31a36b55b5d17d7a09f57a6e6b242e66e344e8daa362f2b44ffd26dc95ea2e1"} Sep 08 10:18:20.959365 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.959335 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b86ls"] Sep 08 10:18:20.962294 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:20.962266 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d373d64_68cb_4acf_aaa2_b32ab5cdf64c.slice/crio-10a235cda3d39ca37469a0eb9a35ac63620bd7c32048f4f7d4950f38b306ba5d WatchSource:0}: Error finding container 10a235cda3d39ca37469a0eb9a35ac63620bd7c32048f4f7d4950f38b306ba5d: Status 404 returned error can't find the container with id 10a235cda3d39ca37469a0eb9a35ac63620bd7c32048f4f7d4950f38b306ba5d Sep 08 10:18:20.973785 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:20.973758 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:21.176796 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.176711 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:21.379271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.379210 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:21.589901 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.589826 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:21.922998 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.922960 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b86ls" event={"ID":"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c","Type":"ContainerStarted","Data":"6cd7682ee3df713557900000cbe0504c27421171a5852264f30519bd0eaca5d8"} Sep 08 10:18:21.923190 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.923018 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b86ls" event={"ID":"5d373d64-68cb-4acf-aaa2-b32ab5cdf64c","Type":"ContainerStarted","Data":"10a235cda3d39ca37469a0eb9a35ac63620bd7c32048f4f7d4950f38b306ba5d"} Sep 08 10:18:21.923190 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.923050 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:18:21.958000 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.957946 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b86ls" podStartSLOduration=66.957925119 podStartE2EDuration="1m6.957925119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:21.957696946 +0000 UTC m=+67.844406461" watchObservedRunningTime="2026-09-08 10:18:21.957925119 +0000 UTC m=+67.844634615" Sep 08 10:18:21.998764 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:21.998735 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:22.179864 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:22.179783 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:22.572189 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:22.572095 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:22.637450 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:22.637414 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:22.662283 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:22.662254 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:22.662428 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:22.662326 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:22.662428 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:22.662372 2532 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 10:18:22.662496 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:22.662448 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:30.662426973 +0000 UTC m=+76.549136460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : configmap "kube-rbac-proxy" not found Sep 08 10:18:22.662496 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:22.662459 2532 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 10:18:22.662568 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:22.662496 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls podName:3699ff39-87cb-4703-a118-b18579397bc6 nodeName:}" failed. No retries permitted until 2026-09-08 10:18:30.662485049 +0000 UTC m=+76.549194534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjwk5" (UID: "3699ff39-87cb-4703-a118-b18579397bc6") : secret "insights-runtime-extractor-tls" not found Sep 08 10:18:22.775509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:22.775473 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:23.168669 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:23.168620 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:23.572022 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:23.571921 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:23.873687 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:23.873580 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:23.876769 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:23.876739 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7ba089c-b99f-48f3-a4ee-83b4d546741d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-dc9m7\" (UID: \"c7ba089c-b99f-48f3-a4ee-83b4d546741d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:23.908948 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:23.908921 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-56cxb\"" Sep 08 10:18:23.917207 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:23.917185 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" Sep 08 10:18:24.709069 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:24.708977 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7"] Sep 08 10:18:24.934307 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:24.934268 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2b2ct" event={"ID":"0fa45e7d-f861-4a82-9355-62781f6cf75b","Type":"ContainerStarted","Data":"9b391cd4aa825162fa420f7ca1eaf0312645eb0671581472f9366776afa8cd8a"} Sep 08 10:18:24.935483 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:24.935456 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" event={"ID":"c7ba089c-b99f-48f3-a4ee-83b4d546741d","Type":"ContainerStarted","Data":"8a213853c75334edd90c356e7f22e6117ce5e16ab258a70d55089198adb644bf"} Sep 08 10:18:24.956326 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:24.956281 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2b2ct" podStartSLOduration=66.121271976 podStartE2EDuration="1m9.956266947s" totalImagesPullingTime="3.834994971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:24.955568631 +0000 UTC m=+70.842278123" watchObservedRunningTime="2026-09-08 10:18:24.956266947 +0000 UTC m=+70.842976437" Sep 08 10:18:26.320841 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.320799 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:26.421639 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.421609 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:26.577367 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.577339 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:26.943008 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.942975 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" event={"ID":"c7ba089c-b99f-48f3-a4ee-83b4d546741d","Type":"ContainerStarted","Data":"e342f20c4f573dcf5ea70f1cda4e62efe36db36d8de621a8349116bce5f9b0af"} Sep 08 10:18:26.943197 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.943024 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" event={"ID":"c7ba089c-b99f-48f3-a4ee-83b4d546741d","Type":"ContainerStarted","Data":"a1b0fc0a024fdf6b7d1b689223d88d384f99da0802fccc98e77e94e8794c3be6"} Sep 08 10:18:26.965886 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.965845 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-dc9m7" podStartSLOduration=18.216146333 podStartE2EDuration="19.965830142s" totalImagesPullingTime="1.749683809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:26.965632034 +0000 UTC m=+72.852341551" watchObservedRunningTime="2026-09-08 10:18:26.965830142 +0000 UTC m=+72.852539634" Sep 08 10:18:26.980555 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:26.980535 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:27.371513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:27.371430 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:27.569154 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:27.569096 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:28.170154 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:28.170098 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:28.379005 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:28.378974 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:28.566472 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:28.566396 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:30.384107 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.384075 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:30.481384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.481352 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:30.548497 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.548465 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:30.679003 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.678970 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:30.729876 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.729847 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:30.729991 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.729900 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:30.730396 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.730365 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3699ff39-87cb-4703-a118-b18579397bc6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:30.732343 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.732324 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3699ff39-87cb-4703-a118-b18579397bc6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjwk5\" (UID: \"3699ff39-87cb-4703-a118-b18579397bc6\") " pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:30.748323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.748298 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjwk5" Sep 08 10:18:30.854118 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.854087 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:30.918835 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:30.918803 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:31.018102 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.018042 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjwk5"] Sep 08 10:18:31.020709 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:31.020686 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3699ff39_87cb_4703_a118_b18579397bc6.slice/crio-bedf3539c822cf3444422da0f57e5b86c96ec86fe2fd75ff6ce8b28005f49297 WatchSource:0}: Error finding container bedf3539c822cf3444422da0f57e5b86c96ec86fe2fd75ff6ce8b28005f49297: Status 404 returned error can't find the container with id bedf3539c822cf3444422da0f57e5b86c96ec86fe2fd75ff6ce8b28005f49297 Sep 08 10:18:31.486216 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.486179 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:31.561576 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.561541 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:31.686850 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.686815 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:31.749390 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.749314 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:31.959274 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.959236 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjwk5" event={"ID":"3699ff39-87cb-4703-a118-b18579397bc6","Type":"ContainerStarted","Data":"b66fd2a62f9153ac9d7fa3280329c35a25583c6f384a1fb70ed518ca4f6da9f3"} Sep 08 10:18:31.959448 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:31.959301 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjwk5" event={"ID":"3699ff39-87cb-4703-a118-b18579397bc6","Type":"ContainerStarted","Data":"bedf3539c822cf3444422da0f57e5b86c96ec86fe2fd75ff6ce8b28005f49297"} Sep 08 10:18:32.263257 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:32.263226 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:32.478464 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:32.478430 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:32.674191 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:32.674158 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:33.894498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:33.894465 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:33.971152 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:33.971110 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:35.063749 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.063718 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr"] Sep 08 10:18:35.066421 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.066404 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.069374 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.069354 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 10:18:35.069656 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.069639 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 10:18:35.069895 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.069875 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 10:18:35.070544 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.070529 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 08 10:18:35.070628 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.070537 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 08 10:18:35.070628 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.070532 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 08 10:18:35.070628 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.070558 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 08 10:18:35.093080 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.093054 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr"] Sep 08 10:18:35.158923 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.158889 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs54s\" (UniqueName: \"kubernetes.io/projected/e1b90307-0596-4eea-b4e5-0a2fa7757582-kube-api-access-cs54s\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.158923 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.158924 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.159121 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.158997 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-ca\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.159121 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.159035 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b90307-0596-4eea-b4e5-0a2fa7757582-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.159121 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.159060 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.159121 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.159078 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-hub\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.166396 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.166372 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b4f9bf57b-nn56m"] Sep 08 10:18:35.168898 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.168881 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.171458 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.171437 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 10:18:35.171586 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.171498 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-svksl\"" Sep 08 10:18:35.171648 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.171627 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 10:18:35.171804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.171790 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 10:18:35.178558 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.178537 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 10:18:35.182467 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.182448 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b4f9bf57b-nn56m"] Sep 08 10:18:35.198275 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.198249 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b4f9bf57b-nn56m"] Sep 08 10:18:35.198542 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:18:35.198504 2532 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-wz7zm registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-wz7zm registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" podUID="376e2573-b067-49bf-884d-56e5f940e19f" Sep 08 10:18:35.260171 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260121 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/376e2573-b067-49bf-884d-56e5f940e19f-ca-trust-extracted\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260352 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260193 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b90307-0596-4eea-b4e5-0a2fa7757582-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.260352 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260233 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.260352 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260260 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-installation-pull-secrets\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260352 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260290 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-hub\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.260352 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260321 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs54s\" (UniqueName: \"kubernetes.io/projected/e1b90307-0596-4eea-b4e5-0a2fa7757582-kube-api-access-cs54s\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.260608 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260372 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.260608 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260472 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-registry-certificates\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260608 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260527 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-image-registry-private-configuration\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260608 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260555 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-registry-tls\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260608 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260585 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-ca\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.260920 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260614 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-bound-sa-token\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260920 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260645 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-trusted-ca\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.260920 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.260672 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz7zm\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-kube-api-access-wz7zm\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.261245 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.261004 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1b90307-0596-4eea-b4e5-0a2fa7757582-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.262996 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.262973 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.263116 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.263040 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.263380 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.263359 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-hub\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.263428 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.263402 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1b90307-0596-4eea-b4e5-0a2fa7757582-ca\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.270050 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.270020 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs54s\" (UniqueName: \"kubernetes.io/projected/e1b90307-0596-4eea-b4e5-0a2fa7757582-kube-api-access-cs54s\") pod \"cluster-proxy-proxy-agent-5c56c746b6-sb5dr\" (UID: \"e1b90307-0596-4eea-b4e5-0a2fa7757582\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.361358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361278 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-image-registry-private-configuration\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.361358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361316 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-registry-tls\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.361358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361333 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-bound-sa-token\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.361358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361351 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-trusted-ca\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.361671 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361647 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz7zm\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-kube-api-access-wz7zm\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.361740 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361720 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/376e2573-b067-49bf-884d-56e5f940e19f-ca-trust-extracted\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.361791 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361780 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-installation-pull-secrets\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.362360 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.361858 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-registry-certificates\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.362360 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.362077 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/376e2573-b067-49bf-884d-56e5f940e19f-ca-trust-extracted\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.362360 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.362332 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-trusted-ca\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.362579 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.362560 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-registry-certificates\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.364012 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.363995 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-registry-tls\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.364094 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.364084 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-image-registry-private-configuration\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.364459 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.364437 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-installation-pull-secrets\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.370966 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.370940 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-bound-sa-token\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.371176 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.371159 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz7zm\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-kube-api-access-wz7zm\") pod \"image-registry-6b4f9bf57b-nn56m\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.397229 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.397202 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" Sep 08 10:18:35.682157 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.682108 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr"] Sep 08 10:18:35.686119 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:35.686095 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1b90307_0596_4eea_b4e5_0a2fa7757582.slice/crio-f65372845679702e3b8c075bb7b6e0b3da3bd3d45dae70acfcec324b81e95cfd WatchSource:0}: Error finding container f65372845679702e3b8c075bb7b6e0b3da3bd3d45dae70acfcec324b81e95cfd: Status 404 returned error can't find the container with id f65372845679702e3b8c075bb7b6e0b3da3bd3d45dae70acfcec324b81e95cfd Sep 08 10:18:35.972758 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.972659 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" event={"ID":"e1b90307-0596-4eea-b4e5-0a2fa7757582","Type":"ContainerStarted","Data":"f65372845679702e3b8c075bb7b6e0b3da3bd3d45dae70acfcec324b81e95cfd"} Sep 08 10:18:35.974474 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.974449 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjwk5" event={"ID":"3699ff39-87cb-4703-a118-b18579397bc6","Type":"ContainerStarted","Data":"ae76d205bbd5d2ff42a6f5d5348445e3942f13d6ae48492878a07fd7068b1877"} Sep 08 10:18:35.974568 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.974475 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:35.980845 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:35.980828 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:36.066545 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066506 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-trusted-ca\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066555 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-installation-pull-secrets\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066582 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-registry-tls\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066607 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz7zm\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-kube-api-access-wz7zm\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066727 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-bound-sa-token\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066783 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-image-registry-private-configuration\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066817 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-registry-certificates\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.066959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.066856 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/376e2573-b067-49bf-884d-56e5f940e19f-ca-trust-extracted\") pod \"376e2573-b067-49bf-884d-56e5f940e19f\" (UID: \"376e2573-b067-49bf-884d-56e5f940e19f\") " Sep 08 10:18:36.067358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.067008 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:18:36.067358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.067108 2532 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-trusted-ca\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.067358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.067282 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376e2573-b067-49bf-884d-56e5f940e19f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:18:36.067517 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.067435 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:18:36.069130 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.069105 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:18:36.069130 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.069100 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:18:36.069305 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.069187 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:18:36.069393 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.069375 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:18:36.069454 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.069439 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-kube-api-access-wz7zm" (OuterVolumeSpecName: "kube-api-access-wz7zm") pod "376e2573-b067-49bf-884d-56e5f940e19f" (UID: "376e2573-b067-49bf-884d-56e5f940e19f"). InnerVolumeSpecName "kube-api-access-wz7zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:18:36.168323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168281 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.168323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168316 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz7zm\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-kube-api-access-wz7zm\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.168323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168328 2532 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376e2573-b067-49bf-884d-56e5f940e19f-bound-sa-token\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.168563 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168340 2532 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-image-registry-private-configuration\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.168563 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168353 2532 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/376e2573-b067-49bf-884d-56e5f940e19f-registry-certificates\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.168563 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168368 2532 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/376e2573-b067-49bf-884d-56e5f940e19f-ca-trust-extracted\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.168563 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.168380 2532 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/376e2573-b067-49bf-884d-56e5f940e19f-installation-pull-secrets\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:18:36.764500 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.764470 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:36.879461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.879427 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:36.977900 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:36.977830 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b4f9bf57b-nn56m" Sep 08 10:18:37.040453 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:37.040421 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b4f9bf57b-nn56m"] Sep 08 10:18:37.044859 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:37.044836 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b4f9bf57b-nn56m"] Sep 08 10:18:38.059389 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:38.059352 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:38.127797 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:38.127751 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:38.658761 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:38.658727 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376e2573-b067-49bf-884d-56e5f940e19f" path="/var/lib/kubelet/pods/376e2573-b067-49bf-884d-56e5f940e19f/volumes" Sep 08 10:18:38.987913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:38.987822 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjwk5" event={"ID":"3699ff39-87cb-4703-a118-b18579397bc6","Type":"ContainerStarted","Data":"ffaf0159c64059ae4c78c43848fa7875d78d755a59945347b396d362d1f7d593"} Sep 08 10:18:39.013393 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:39.012704 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wjwk5" podStartSLOduration=17.334928404 podStartE2EDuration="25.012682578s" totalImagesPullingTime="7.677754174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:18:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:39.011383414 +0000 UTC m=+84.898092924" watchObservedRunningTime="2026-09-08 10:18:39.012682578 +0000 UTC m=+84.899392076" Sep 08 10:18:43.005152 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:43.005109 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" event={"ID":"e1b90307-0596-4eea-b4e5-0a2fa7757582","Type":"ContainerStarted","Data":"0bb4a05a4f47e89ce417294bd0b5e3b5c6fcb51c8d131a83acdced1e6fbf5a4b"} Sep 08 10:18:43.005521 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:43.005174 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" event={"ID":"e1b90307-0596-4eea-b4e5-0a2fa7757582","Type":"ContainerStarted","Data":"fb7bdae278418ad26e72b2d94ef601a5ea94532dfe947e5d736cdd6acd0ebbc0"} Sep 08 10:18:43.005521 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:43.005196 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" event={"ID":"e1b90307-0596-4eea-b4e5-0a2fa7757582","Type":"ContainerStarted","Data":"c79ca4da191cf5c83e9fd8af4cd29b03ebcf26b8e5e74beec52bf669293927f6"} Sep 08 10:18:43.025954 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:43.025905 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c56c746b6-sb5dr" podStartSLOduration=1.5222081219999999 podStartE2EDuration="8.025890859s" totalImagesPullingTime="6.503682737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:43.024613103 +0000 UTC m=+88.911322597" watchObservedRunningTime="2026-09-08 10:18:43.025890859 +0000 UTC m=+88.912600353" Sep 08 10:18:43.831397 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:43.831364 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:43.897220 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:43.897192 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:45.036051 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:45.036015 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:45.146126 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:45.146091 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:48.767670 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:48.767638 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:48.869987 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:48.869955 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:49.946518 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:49.946488 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:50.051388 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:50.051348 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:51.491337 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:51.491303 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:52.900909 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:52.900875 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:18:52.903333 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:52.903309 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e09965ad-afe0-48da-98ee-e47d127c704e-metrics-tls\") pod \"dns-default-qwnl9\" (UID: \"e09965ad-afe0-48da-98ee-e47d127c704e\") " pod="openshift-dns/dns-default-qwnl9" Sep 08 10:18:52.929490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:52.929453 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b86ls" Sep 08 10:18:53.162942 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:53.162859 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7bmn\"" Sep 08 10:18:53.170883 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:53.170861 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qwnl9" Sep 08 10:18:53.352409 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:53.352374 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:53.451272 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:53.451222 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qwnl9"] Sep 08 10:18:53.453603 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:18:53.453576 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode09965ad_afe0_48da_98ee_e47d127c704e.slice/crio-5e3b776e80bfb87101ea0348b61f737af193bb073302616ec4346542963d1758 WatchSource:0}: Error finding container 5e3b776e80bfb87101ea0348b61f737af193bb073302616ec4346542963d1758: Status 404 returned error can't find the container with id 5e3b776e80bfb87101ea0348b61f737af193bb073302616ec4346542963d1758 Sep 08 10:18:54.040301 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:54.040221 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qwnl9" event={"ID":"e09965ad-afe0-48da-98ee-e47d127c704e","Type":"ContainerStarted","Data":"5e3b776e80bfb87101ea0348b61f737af193bb073302616ec4346542963d1758"} Sep 08 10:18:55.181234 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:55.181195 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:55.282193 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:55.282168 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:56.048855 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.048815 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qwnl9" event={"ID":"e09965ad-afe0-48da-98ee-e47d127c704e","Type":"ContainerStarted","Data":"3593f2778081b0d467f72b0dfc11a82b644760bc21b3a55314b09dc3bff08eaa"} Sep 08 10:18:56.049017 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.048877 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qwnl9" event={"ID":"e09965ad-afe0-48da-98ee-e47d127c704e","Type":"ContainerStarted","Data":"2c2216841e3e8f179c3cf9ff84039671d385b4517230a2e5d12fe47ab86bf7c7"} Sep 08 10:18:56.049017 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.048905 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qwnl9" Sep 08 10:18:56.070402 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.070352 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qwnl9" podStartSLOduration=66.284644463 podStartE2EDuration="1m8.07033624s" totalImagesPullingTime="1.785691777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:56.069048682 +0000 UTC m=+101.955758188" watchObservedRunningTime="2026-09-08 10:18:56.07033624 +0000 UTC m=+101.957045768" Sep 08 10:18:56.303261 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.303177 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:56.390916 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.390880 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:56.501737 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:56.501699 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:57.819166 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:57.819116 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:57.916019 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:57.915988 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:58.892494 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:58.892461 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:58.993906 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:58.993872 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:59.106709 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:59.106675 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:18:59.299735 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:18:59.299694 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:01.491174 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.491124 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:01.717093 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.717060 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:01.766049 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.765964 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s74zf"] Sep 08 10:19:01.771704 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.771682 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.774112 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.774086 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 10:19:01.774629 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.774607 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 10:19:01.775365 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.774952 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 10:19:01.775365 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.775078 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 10:19:01.775365 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.775342 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 10:19:01.776812 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.776790 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9s5qq\"" Sep 08 10:19:01.777063 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.777040 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 10:19:01.859051 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.858992 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:01.873063 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873030 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-root\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873231 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873088 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-accelerators-collector-config\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873231 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873167 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-metrics-client-ca\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873231 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873214 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lwrm\" (UniqueName: \"kubernetes.io/projected/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-kube-api-access-4lwrm\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873326 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873237 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873326 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873277 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-sys\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873326 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873296 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-tls\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873417 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873326 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-textfile\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.873417 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.873343 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-wtmp\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.950322 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.950286 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:01.974573 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974528 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lwrm\" (UniqueName: \"kubernetes.io/projected/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-kube-api-access-4lwrm\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974573 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974574 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974797 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974698 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-sys\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974797 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974742 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-tls\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974797 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974777 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-textfile\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974931 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974801 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-wtmp\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974931 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974805 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-sys\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974931 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974832 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-root\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.974931 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974898 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-accelerators-collector-config\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.975116 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974933 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-metrics-client-ca\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.975116 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974951 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-wtmp\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.975116 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.974951 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-root\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.975302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.975122 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-textfile\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.975462 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.975434 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-metrics-client-ca\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.975579 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.975557 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-accelerators-collector-config\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.977039 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.977011 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.977180 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.977156 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-node-exporter-tls\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:01.992751 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:01.992724 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lwrm\" (UniqueName: \"kubernetes.io/projected/2f2cda76-1dbe-4da7-90c5-32e0aa1e9945-kube-api-access-4lwrm\") pod \"node-exporter-s74zf\" (UID: \"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945\") " pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:02.041065 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:02.040983 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:02.085527 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:02.085500 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s74zf" Sep 08 10:19:02.099540 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:19:02.099496 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2cda76_1dbe_4da7_90c5_32e0aa1e9945.slice/crio-cf537a08a6228ad9a3c65ae7b31252536b624f24ea1ca5d79d10e68909e591be WatchSource:0}: Error finding container cf537a08a6228ad9a3c65ae7b31252536b624f24ea1ca5d79d10e68909e591be: Status 404 returned error can't find the container with id cf537a08a6228ad9a3c65ae7b31252536b624f24ea1ca5d79d10e68909e591be Sep 08 10:19:02.170329 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:02.170295 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:02.348088 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:02.348007 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:02.762462 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:02.762430 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:02.865363 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:02.865332 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:03.073159 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:03.073058 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s74zf" event={"ID":"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945","Type":"ContainerStarted","Data":"cf537a08a6228ad9a3c65ae7b31252536b624f24ea1ca5d79d10e68909e591be"} Sep 08 10:19:03.084689 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:03.084652 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:03.176822 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:03.176776 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:03.928376 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:03.928310 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:04.029402 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:04.029363 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:05.081436 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:05.081401 2532 generic.go:356] "Generic (PLEG): container finished" podID="2f2cda76-1dbe-4da7-90c5-32e0aa1e9945" containerID="eb605a6f241cb9c656aac27ef31e61ddf9c847c10b03b0d54844315e7bfae8a7" exitCode=0 Sep 08 10:19:05.081843 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:05.081497 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s74zf" event={"ID":"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945","Type":"ContainerDied","Data":"eb605a6f241cb9c656aac27ef31e61ddf9c847c10b03b0d54844315e7bfae8a7"} Sep 08 10:19:06.054693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:06.054662 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qwnl9" Sep 08 10:19:06.088555 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:06.088518 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s74zf" event={"ID":"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945","Type":"ContainerStarted","Data":"0754f5f024e5904fd7f8350fc624b9a4ad9a4c9c2b7c36ac7168b56b989fcdc3"} Sep 08 10:19:06.088986 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:06.088580 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s74zf" event={"ID":"2f2cda76-1dbe-4da7-90c5-32e0aa1e9945","Type":"ContainerStarted","Data":"21027301345c37c45509cdbf57df0623cf94fcc7f7177cdad5e1b7951829dd2c"} Sep 08 10:19:06.109202 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:06.109083 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s74zf" podStartSLOduration=2.524624171 podStartE2EDuration="5.109065889s" totalImagesPullingTime="2.515088441s" totalInitContainerRuntime="69.353277ms" isStatefulPod=true podCreationTimestamp="2026-09-08 10:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:19:06.107594131 +0000 UTC m=+111.994303651" watchObservedRunningTime="2026-09-08 10:19:06.109065889 +0000 UTC m=+111.995775382" Sep 08 10:19:07.852565 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:07.852530 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:07.950690 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:07.950634 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:08.052335 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:08.052281 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:08.151030 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:08.150982 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:14.738766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:14.738723 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:14.810499 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:14.810443 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:15.844126 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:15.844094 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:15.909433 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:15.909399 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:17.341156 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:17.341108 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:17.479254 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:17.479220 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:17.542515 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:17.542492 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:17.898737 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:17.898706 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:18.000082 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:18.000050 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:18.100265 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:18.100235 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:23.052080 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:23.052050 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:23.115087 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:23.115053 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:23.757717 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:23.757688 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:23.858445 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:23.858416 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:24.549543 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:24.549481 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:19:24.551981 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:24.551962 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec-metrics-certs\") pod \"network-metrics-daemon-rlbmt\" (UID: \"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec\") " pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:19:24.568290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:24.568264 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljzsh\"" Sep 08 10:19:24.576322 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:24.576300 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlbmt" Sep 08 10:19:24.846104 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:24.846026 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlbmt"] Sep 08 10:19:24.849014 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:19:24.848972 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7900bcde_f292_4ce6_a9cf_c9f0ce2e2bec.slice/crio-37a00999be2b1528c274b449f2a77144ee1f25b38cfbb68f31932b1c9eeafcdb WatchSource:0}: Error finding container 37a00999be2b1528c274b449f2a77144ee1f25b38cfbb68f31932b1c9eeafcdb: Status 404 returned error can't find the container with id 37a00999be2b1528c274b449f2a77144ee1f25b38cfbb68f31932b1c9eeafcdb Sep 08 10:19:25.152703 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:25.152669 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlbmt" event={"ID":"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec","Type":"ContainerStarted","Data":"37a00999be2b1528c274b449f2a77144ee1f25b38cfbb68f31932b1c9eeafcdb"} Sep 08 10:19:26.025496 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:26.025406 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:26.125205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:26.125166 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:26.160180 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:26.160117 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlbmt" event={"ID":"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec","Type":"ContainerStarted","Data":"6a310d2e47a1eead22ce0af5a82c4aa114824f6f850c0f10c271208cf0885ee4"} Sep 08 10:19:26.160334 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:26.160238 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlbmt" event={"ID":"7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec","Type":"ContainerStarted","Data":"a6e83d0c8039006dbad4a8231face98377ca419e8e4a3210ccbe4517dda307c8"} Sep 08 10:19:26.176821 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:26.176761 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rlbmt" podStartSLOduration=130.302711298 podStartE2EDuration="2m11.176744271s" totalImagesPullingTime="874.032973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:19:26.176510283 +0000 UTC m=+132.063219792" watchObservedRunningTime="2026-09-08 10:19:26.176744271 +0000 UTC m=+132.063453764" Sep 08 10:19:26.273124 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:26.273092 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:27.869979 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:27.869941 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:27.929273 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:27.929243 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:19:39.205513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:39.205478 2532 generic.go:356] "Generic (PLEG): container finished" podID="eb0e5afe-33be-434d-8625-9d93104d489e" containerID="ee9f68e9473338b518af5683f5954f0cf0c28fbe9071025372fd37c44bdff9c4" exitCode=0 Sep 08 10:19:39.205915 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:39.205525 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" event={"ID":"eb0e5afe-33be-434d-8625-9d93104d489e","Type":"ContainerDied","Data":"ee9f68e9473338b518af5683f5954f0cf0c28fbe9071025372fd37c44bdff9c4"} Sep 08 10:19:39.205983 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:39.205934 2532 scope.go:117] "RemoveContainer" containerID="ee9f68e9473338b518af5683f5954f0cf0c28fbe9071025372fd37c44bdff9c4" Sep 08 10:19:40.210859 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:40.210821 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-m8r6n" event={"ID":"eb0e5afe-33be-434d-8625-9d93104d489e","Type":"ContainerStarted","Data":"19ccf459a5f23054ea22230bb2de40b6fb0d4b16c4b717a48d1ca98a3a118473"} Sep 08 10:19:42.218506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:42.218472 2532 generic.go:356] "Generic (PLEG): container finished" podID="9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8" containerID="09242d177e3ecdd624572a3b21aed2b46f9353e62921d2ad59a28eeba86d2d59" exitCode=0 Sep 08 10:19:42.218886 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:42.218531 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" event={"ID":"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8","Type":"ContainerDied","Data":"09242d177e3ecdd624572a3b21aed2b46f9353e62921d2ad59a28eeba86d2d59"} Sep 08 10:19:42.218886 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:42.218849 2532 scope.go:117] "RemoveContainer" containerID="09242d177e3ecdd624572a3b21aed2b46f9353e62921d2ad59a28eeba86d2d59" Sep 08 10:19:43.224055 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:19:43.224022 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-pbcp9" event={"ID":"9ab4b2a2-b23e-48b7-a4fb-e971e66f5fc8","Type":"ContainerStarted","Data":"3b4775965ebd1607fe8f10890510816f5f26354611e08ebaaa50ea5482225575"} Sep 08 10:20:00.508179 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:00.508120 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:21.057396 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:21.057309 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:21.295903 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:21.295860 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:24.550272 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:24.550239 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:29.279911 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:29.279876 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:36.340355 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:36.340319 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:36.403038 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:36.403006 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:48.407653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:48.407620 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:48.509653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:48.509620 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:50.294266 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:50.294227 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:50.391396 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:50.391359 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:50.518896 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:50.518860 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:53.076486 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:53.076447 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:53.178288 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:53.178244 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:20:53.279079 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:20:53.279041 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:21:10.192669 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:21:10.192632 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:21:10.271427 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:21:10.271400 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:22:14.553353 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:22:14.553320 2532 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 10:22:22.127382 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:22:22.127339 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:22:55.286211 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:22:55.286177 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:10.077612 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:10.077531 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:10.148264 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:10.148235 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:10.917304 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:10.917254 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:43.059940 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:43.059904 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:43.193196 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:43.193160 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:43.295295 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:43.295263 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:43.796758 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:43.796725 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:43.897382 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:43.897351 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:52.323120 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:52.323088 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:52.401401 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:52.401353 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:53.025112 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:53.025071 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:53.129664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:53.129631 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:56.284788 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:56.284759 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:23:56.352682 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:23:56.352654 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:24:46.491980 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:24:46.491895 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:30.537420 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:30.537385 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:48.219390 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:48.219348 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:48.318174 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:48.318125 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:48.547353 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:48.547277 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:48.648233 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:48.648205 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:48.804440 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:48.804364 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:48.905061 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:48.905035 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:25:49.005536 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:25:49.005509 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:26:11.798356 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:26:11.798277 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:13.285720 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:27:13.285686 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:13.386128 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:27:13.386096 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:13.804489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:27:13.804458 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:14.311251 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:27:14.311206 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:14.406747 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:27:14.406717 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:27:57.303007 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:27:57.302967 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:28:58.628898 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:28:58.628866 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:01.775895 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:01.775852 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:03.608483 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:03.608450 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:16.385051 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:16.385019 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:16.484436 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:16.484402 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:41.735583 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:41.735546 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:41.983853 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:41.983824 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:42.082368 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:42.082284 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:51.407573 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:51.407523 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:29:51.534392 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:29:51.534361 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:30:16.126146 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:16.126080 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:30:17.444392 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.444356 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-zffjc"] Sep 08 10:30:17.447394 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.447379 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:17.449886 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.449870 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 08 10:30:17.449962 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.449883 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 10:30:17.450746 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.450728 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 10:30:17.450833 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.450730 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-cbmfr\"" Sep 08 10:30:17.456822 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.456802 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-zffjc"] Sep 08 10:30:17.540253 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.540212 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkf7s\" (UniqueName: \"kubernetes.io/projected/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe-kube-api-access-xkf7s\") pod \"feast-test-apply-zffjc\" (UID: \"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe\") " pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:17.641511 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.641467 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkf7s\" (UniqueName: \"kubernetes.io/projected/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe-kube-api-access-xkf7s\") pod \"feast-test-apply-zffjc\" (UID: \"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe\") " pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:17.650901 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.650868 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkf7s\" (UniqueName: \"kubernetes.io/projected/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe-kube-api-access-xkf7s\") pod \"feast-test-apply-zffjc\" (UID: \"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe\") " pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:17.756080 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:17.755990 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:18.028364 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:18.028296 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-zffjc"] Sep 08 10:30:18.031638 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:30:18.031610 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fe9e6d5_ca64_4745_8fc0_f22a0be04bfe.slice/crio-73911fb908637b4b2bc7da2187374d91748ca09b1e8ad6c1f63d4170c3e880ed WatchSource:0}: Error finding container 73911fb908637b4b2bc7da2187374d91748ca09b1e8ad6c1f63d4170c3e880ed: Status 404 returned error can't find the container with id 73911fb908637b4b2bc7da2187374d91748ca09b1e8ad6c1f63d4170c3e880ed Sep 08 10:30:18.033503 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:18.033486 2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:30:18.385685 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:18.385599 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zffjc" event={"ID":"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe","Type":"ContainerStarted","Data":"73911fb908637b4b2bc7da2187374d91748ca09b1e8ad6c1f63d4170c3e880ed"} Sep 08 10:30:23.413116 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:23.413080 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zffjc" event={"ID":"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe","Type":"ContainerStarted","Data":"74776c3a13d6046a8f93619ff468f80e020c5e7ee01f97cc5dcefa45e9e80a8d"} Sep 08 10:30:29.434599 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:29.434511 2532 generic.go:356] "Generic (PLEG): container finished" podID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerID="74776c3a13d6046a8f93619ff468f80e020c5e7ee01f97cc5dcefa45e9e80a8d" exitCode=0 Sep 08 10:30:29.434599 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:29.434572 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zffjc" event={"ID":"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe","Type":"ContainerDied","Data":"74776c3a13d6046a8f93619ff468f80e020c5e7ee01f97cc5dcefa45e9e80a8d"} Sep 08 10:30:30.439985 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:30.439948 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zffjc" event={"ID":"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe","Type":"ContainerStarted","Data":"14267b6aedfbbbbf0d8569779a3cf14a699b31d993cf0022f62259d9efdded19"} Sep 08 10:30:30.458596 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:30.458545 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-zffjc" podStartSLOduration=2.387142263 podStartE2EDuration="13.458525231s" totalImagesPullingTime="4.700301531s" totalInitContainerRuntime="6.371081437s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:30:30.458181426 +0000 UTC m=+796.344890916" watchObservedRunningTime="2026-09-08 10:30:30.458525231 +0000 UTC m=+796.345234725" Sep 08 10:30:39.473962 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:39.473922 2532 generic.go:356] "Generic (PLEG): container finished" podID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerID="14267b6aedfbbbbf0d8569779a3cf14a699b31d993cf0022f62259d9efdded19" exitCode=0 Sep 08 10:30:39.474338 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:39.473998 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zffjc" event={"ID":"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe","Type":"ContainerDied","Data":"14267b6aedfbbbbf0d8569779a3cf14a699b31d993cf0022f62259d9efdded19"} Sep 08 10:30:40.600185 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:40.600162 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:40.600482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:40.600415 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkf7s\" (UniqueName: \"kubernetes.io/projected/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe-kube-api-access-xkf7s\") pod \"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe\" (UID: \"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe\") " Sep 08 10:30:40.602628 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:40.602608 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe-kube-api-access-xkf7s" (OuterVolumeSpecName: "kube-api-access-xkf7s") pod "8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" (UID: "8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe"). InnerVolumeSpecName "kube-api-access-xkf7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:30:40.701382 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:40.701346 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkf7s\" (UniqueName: \"kubernetes.io/projected/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe-kube-api-access-xkf7s\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:30:41.482910 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:41.482881 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-zffjc" event={"ID":"8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe","Type":"ContainerDied","Data":"73911fb908637b4b2bc7da2187374d91748ca09b1e8ad6c1f63d4170c3e880ed"} Sep 08 10:30:41.482910 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:41.482896 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-zffjc" Sep 08 10:30:41.482910 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:41.482917 2532 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73911fb908637b4b2bc7da2187374d91748ca09b1e8ad6c1f63d4170c3e880ed" Sep 08 10:30:41.669342 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:41.669313 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-zffjc_8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe/feast-1/0.log" Sep 08 10:30:41.676299 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:30:41.676274 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-zffjc_8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe/feast-0/0.log" Sep 08 10:31:02.077356 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:02.077314 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:13.626644 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:13.626594 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:18.606422 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:18.606379 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-zffjc"] Sep 08 10:31:18.607404 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:18.607373 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-zffjc"] Sep 08 10:31:18.657968 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:18.657935 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" path="/var/lib/kubelet/pods/8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe/volumes" Sep 08 10:31:18.698439 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:18.698406 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:55.840911 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:55.840860 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:55.941631 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:55.941601 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:57.353792 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:57.353752 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:57.453498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:57.453459 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:31:57.527605 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:31:57.527562 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:20.234537 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:33:20.234509 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:56.032755 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:33:56.032719 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:56.134566 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:33:56.134534 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:33:56.303536 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:33:56.303452 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:01.709706 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:01.709670 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:07.177017 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:07.176989 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:07.257085 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:07.257053 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:07.353041 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:07.353007 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:08.049401 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:08.049365 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:33.427449 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:33.427415 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:38.204552 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:38.204521 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:38.316335 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:38.316306 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:38.531379 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:38.531262 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:34:38.671025 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:34:38.670955 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:19.787460 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:19.787417 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:26.007959 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:26.007927 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:28.527213 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:28.527175 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:28.909962 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:28.909916 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:29.126976 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:29.126935 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:29.202957 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:29.202870 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:31.051528 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:31.051489 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:34.471606 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:34.471566 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:34.541277 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:34.541245 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:39.941106 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:39.941016 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:40.071847 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.071809 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:40.613202 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.613158 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:40.659203 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.659170 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl"] Sep 08 10:36:40.659463 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.659450 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerName="feast-0" Sep 08 10:36:40.659506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.659465 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerName="feast-0" Sep 08 10:36:40.659506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.659475 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerName="feast-1" Sep 08 10:36:40.659506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.659481 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerName="feast-1" Sep 08 10:36:40.659599 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.659516 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe9e6d5-ca64-4745-8fc0-f22a0be04bfe" containerName="feast-1" Sep 08 10:36:40.662185 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.662170 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:40.664824 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.664800 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 10:36:40.665773 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.665746 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 10:36:40.665874 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.665761 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-g6vgr\"" Sep 08 10:36:40.680894 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.680871 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl"] Sep 08 10:36:40.828932 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.828888 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb9f6\" (UniqueName: \"kubernetes.io/projected/a1e7951c-76c6-4230-9bfe-177e6d55cf9f-kube-api-access-jb9f6\") pod \"feast-operator-controller-manager-689b877b4b-8fsxl\" (UID: \"a1e7951c-76c6-4230-9bfe-177e6d55cf9f\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:40.929776 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.929736 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb9f6\" (UniqueName: \"kubernetes.io/projected/a1e7951c-76c6-4230-9bfe-177e6d55cf9f-kube-api-access-jb9f6\") pod \"feast-operator-controller-manager-689b877b4b-8fsxl\" (UID: \"a1e7951c-76c6-4230-9bfe-177e6d55cf9f\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:40.941293 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.941266 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb9f6\" (UniqueName: \"kubernetes.io/projected/a1e7951c-76c6-4230-9bfe-177e6d55cf9f-kube-api-access-jb9f6\") pod \"feast-operator-controller-manager-689b877b4b-8fsxl\" (UID: \"a1e7951c-76c6-4230-9bfe-177e6d55cf9f\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:40.972115 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:40.972089 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:41.258671 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:41.258583 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl"] Sep 08 10:36:41.262147 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:36:41.262109 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e7951c_76c6_4230_9bfe_177e6d55cf9f.slice/crio-8b865f264b27a557459a28b7f682b3524aa10243614759784f1252f9424f1387 WatchSource:0}: Error finding container 8b865f264b27a557459a28b7f682b3524aa10243614759784f1252f9424f1387: Status 404 returned error can't find the container with id 8b865f264b27a557459a28b7f682b3524aa10243614759784f1252f9424f1387 Sep 08 10:36:41.263916 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:41.263900 2532 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 10:36:41.719288 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:41.719259 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" event={"ID":"a1e7951c-76c6-4230-9bfe-177e6d55cf9f","Type":"ContainerStarted","Data":"8b865f264b27a557459a28b7f682b3524aa10243614759784f1252f9424f1387"} Sep 08 10:36:43.728574 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:43.728533 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" event={"ID":"a1e7951c-76c6-4230-9bfe-177e6d55cf9f","Type":"ContainerStarted","Data":"762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9"} Sep 08 10:36:43.728950 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:43.728614 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:43.749991 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:43.749942 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" podStartSLOduration=1.655333334 podStartE2EDuration="3.749923057s" totalImagesPullingTime="2.094589723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:36:43.749085179 +0000 UTC m=+1169.635794691" watchObservedRunningTime="2026-09-08 10:36:43.749923057 +0000 UTC m=+1169.636632551" Sep 08 10:36:54.734789 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:54.734749 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:36:56.847389 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:56.847350 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:56.948173 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:56.948117 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:57.416423 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.416387 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:57.516809 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.516767 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:57.584970 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.584943 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s"] Sep 08 10:36:57.588653 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.588636 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.599681 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.599661 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 10:36:57.599681 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.599673 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 10:36:57.599853 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.599696 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tw5ms\"" Sep 08 10:36:57.599853 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.599818 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 10:36:57.599968 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.599903 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 10:36:57.600025 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.600007 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 10:36:57.600025 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.600015 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 10:36:57.629650 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.629628 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s"] Sep 08 10:36:57.643733 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.643708 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:57.654797 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.654777 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5b742c75-b05e-482f-8b21-0599597bf190-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.654881 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.654805 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.654881 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.654831 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.654881 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.654872 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.654979 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.654896 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.654979 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.654973 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn5fn\" (UniqueName: \"kubernetes.io/projected/5b742c75-b05e-482f-8b21-0599597bf190-kube-api-access-dn5fn\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.750024 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.749942 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:57.755979 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.755953 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.756099 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.755989 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.756099 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.756012 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.756245 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.756212 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.756302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.756258 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn5fn\" (UniqueName: \"kubernetes.io/projected/5b742c75-b05e-482f-8b21-0599597bf190-kube-api-access-dn5fn\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.756367 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.756298 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5b742c75-b05e-482f-8b21-0599597bf190-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.756678 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.756649 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5b742c75-b05e-482f-8b21-0599597bf190-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.758729 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.758710 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.758861 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.758840 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.759118 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.759100 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.759239 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.759218 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.766151 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.766112 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn5fn\" (UniqueName: \"kubernetes.io/projected/5b742c75-b05e-482f-8b21-0599597bf190-kube-api-access-dn5fn\") pod \"feast-simple-feast-setup-57576b8fcf-qnr9s\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:57.844740 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.844710 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:36:57.897721 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:57.897686 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:36:58.182683 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:58.182526 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s"] Sep 08 10:36:58.184754 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:36:58.184729 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b742c75_b05e_482f_8b21_0599597bf190.slice/crio-d47894c0093f17da8e051d7137777222dfcc194603629ee8e24e546bf2bec93e WatchSource:0}: Error finding container d47894c0093f17da8e051d7137777222dfcc194603629ee8e24e546bf2bec93e: Status 404 returned error can't find the container with id d47894c0093f17da8e051d7137777222dfcc194603629ee8e24e546bf2bec93e Sep 08 10:36:58.786553 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:36:58.786513 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"d47894c0093f17da8e051d7137777222dfcc194603629ee8e24e546bf2bec93e"} Sep 08 10:37:09.560491 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:09.560453 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:37:09.616668 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:09.616631 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:37:09.783737 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:09.783700 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:37:10.845731 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:10.845696 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"5b170d2c94671c8a4c1a864c082848db871aef78ab15fbd074e5cf2443db2837"} Sep 08 10:37:14.628306 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:14.628280 2532 scope.go:117] "RemoveContainer" containerID="14267b6aedfbbbbf0d8569779a3cf14a699b31d993cf0022f62259d9efdded19" Sep 08 10:37:14.637065 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:14.637044 2532 scope.go:117] "RemoveContainer" containerID="74776c3a13d6046a8f93619ff468f80e020c5e7ee01f97cc5dcefa45e9e80a8d" Sep 08 10:37:15.866024 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:15.865940 2532 generic.go:356] "Generic (PLEG): container finished" podID="5b742c75-b05e-482f-8b21-0599597bf190" containerID="5b170d2c94671c8a4c1a864c082848db871aef78ab15fbd074e5cf2443db2837" exitCode=0 Sep 08 10:37:15.866024 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:15.865990 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"5b170d2c94671c8a4c1a864c082848db871aef78ab15fbd074e5cf2443db2837"} Sep 08 10:37:16.871338 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:16.871295 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"d145032ad021e9dc8b4fb72355704a5bc506aaa18e6ee8287586e6f438154330"} Sep 08 10:37:21.891944 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:21.891907 2532 generic.go:356] "Generic (PLEG): container finished" podID="5b742c75-b05e-482f-8b21-0599597bf190" containerID="d145032ad021e9dc8b4fb72355704a5bc506aaa18e6ee8287586e6f438154330" exitCode=0 Sep 08 10:37:21.892461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:21.891980 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"d145032ad021e9dc8b4fb72355704a5bc506aaa18e6ee8287586e6f438154330"} Sep 08 10:37:22.902267 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:22.902220 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"6ee14ee81e4a2d1f59bee639e74c00d954fc9e41f605f6ee0f2dfcd6d24938b5"} Sep 08 10:37:22.902719 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:22.902288 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"07946451786aa4b2135fe3bf314d21354708402d1f253cc6c20492b26715ed7b"} Sep 08 10:37:22.902719 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:22.902310 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"16fdf004343e7d00bf87aede27a26b9fb4dd655735e2ca4d045ab980d334264c"} Sep 08 10:37:22.902719 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:22.902330 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerStarted","Data":"4f9b02c4238976a06609d7f8c24ef299e12261bf57ccac99122bcbbbd3e19f57"} Sep 08 10:37:22.930662 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:22.930589 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podStartSLOduration=13.46584191 podStartE2EDuration="25.930565222s" totalImagesPullingTime="12.464723312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:37:22.928640374 +0000 UTC m=+1208.815349869" watchObservedRunningTime="2026-09-08 10:37:22.930565222 +0000 UTC m=+1208.817274717" Sep 08 10:37:24.898159 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.898103 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:24.898739 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.898702 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:24.899276 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.899210 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:24.899276 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.899250 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:24.900302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.900049 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Sep 08 10:37:24.900302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.900047 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.18:6571: connect: connection refused" Sep 08 10:37:24.900302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.900052 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Sep 08 10:37:24.900302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:24.900126 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.18:8816: connect: connection refused" Sep 08 10:37:27.898279 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.898239 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:27.898878 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.898853 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:27.899125 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.898723 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Sep 08 10:37:27.899272 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.898629 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.18:6571: connect: connection refused" Sep 08 10:37:27.899272 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.899067 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Sep 08 10:37:27.899388 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.899071 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.18:8816: connect: connection refused" Sep 08 10:37:27.899388 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.899316 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:27.899388 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:27.899349 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.899260 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.899226 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.899715 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.899368 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.899928 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.899882 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.900079 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.900063 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.900255 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.900238 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.900322 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.900292 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.904571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.904553 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:30.948547 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:30.948510 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:37:51.071361 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:37:51.071322 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:30.603935 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:30.603892 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:30.669609 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:30.669573 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:33.021541 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.021498 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:33.901058 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.901024 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:33.907130 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.907101 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s"] Sep 08 10:38:33.907489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.907431 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="registry" containerID="cri-o://4f9b02c4238976a06609d7f8c24ef299e12261bf57ccac99122bcbbbd3e19f57" gracePeriod=30 Sep 08 10:38:33.907581 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.907500 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="offline" containerID="cri-o://07946451786aa4b2135fe3bf314d21354708402d1f253cc6c20492b26715ed7b" gracePeriod=30 Sep 08 10:38:33.907581 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.907510 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" containerID="cri-o://6ee14ee81e4a2d1f59bee639e74c00d954fc9e41f605f6ee0f2dfcd6d24938b5" gracePeriod=30 Sep 08 10:38:33.907741 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:33.907690 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" containerID="cri-o://16fdf004343e7d00bf87aede27a26b9fb4dd655735e2ca4d045ab980d334264c" gracePeriod=30 Sep 08 10:38:34.004129 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.004088 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:34.233628 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.233535 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:34.331938 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.331886 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:34.459334 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.459300 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25"] Sep 08 10:38:34.463437 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.463413 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.465680 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.465661 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-59h7c\"" Sep 08 10:38:34.480778 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.480750 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25"] Sep 08 10:38:34.491435 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.491363 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.491435 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.491399 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2b14dbc0-2001-40f6-b4db-8f8e312365ff-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.491435 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.491427 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.491652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.491538 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.491652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.491615 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llw52\" (UniqueName: \"kubernetes.io/projected/2b14dbc0-2001-40f6-b4db-8f8e312365ff-kube-api-access-llw52\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.491652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.491648 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.520288 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.520247 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:34.579378 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.579339 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:34.592389 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592360 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llw52\" (UniqueName: \"kubernetes.io/projected/2b14dbc0-2001-40f6-b4db-8f8e312365ff-kube-api-access-llw52\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.592505 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592395 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.592505 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592421 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.592505 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592437 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2b14dbc0-2001-40f6-b4db-8f8e312365ff-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.592505 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592457 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.592505 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592479 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.592827 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.592805 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2b14dbc0-2001-40f6-b4db-8f8e312365ff-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.595346 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.595316 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.595466 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.595442 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.595509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.595487 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.595566 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.595542 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.602182 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.602158 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llw52\" (UniqueName: \"kubernetes.io/projected/2b14dbc0-2001-40f6-b4db-8f8e312365ff-kube-api-access-llw52\") pod \"feast-simple-feast-setup-57576b8fcf-x4d25\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:34.678716 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.678670 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:38:34.774718 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:34.774640 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:35.056304 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.056278 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25"] Sep 08 10:38:35.057639 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:38:35.057614 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b14dbc0_2001_40f6_b4db_8f8e312365ff.slice/crio-afec4f79ed86f6fee8a005cd33b36a543cc617baf8a9671fba95bf9274343c63 WatchSource:0}: Error finding container afec4f79ed86f6fee8a005cd33b36a543cc617baf8a9671fba95bf9274343c63: Status 404 returned error can't find the container with id afec4f79ed86f6fee8a005cd33b36a543cc617baf8a9671fba95bf9274343c63 Sep 08 10:38:35.181409 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.181366 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3"} Sep 08 10:38:35.181409 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.181410 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"afec4f79ed86f6fee8a005cd33b36a543cc617baf8a9671fba95bf9274343c63"} Sep 08 10:38:35.184687 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.184655 2532 generic.go:356] "Generic (PLEG): container finished" podID="5b742c75-b05e-482f-8b21-0599597bf190" containerID="6ee14ee81e4a2d1f59bee639e74c00d954fc9e41f605f6ee0f2dfcd6d24938b5" exitCode=0 Sep 08 10:38:35.184687 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.184682 2532 generic.go:356] "Generic (PLEG): container finished" podID="5b742c75-b05e-482f-8b21-0599597bf190" containerID="16fdf004343e7d00bf87aede27a26b9fb4dd655735e2ca4d045ab980d334264c" exitCode=0 Sep 08 10:38:35.184962 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.184735 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"6ee14ee81e4a2d1f59bee639e74c00d954fc9e41f605f6ee0f2dfcd6d24938b5"} Sep 08 10:38:35.184962 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:35.184768 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"16fdf004343e7d00bf87aede27a26b9fb4dd655735e2ca4d045ab980d334264c"} Sep 08 10:38:40.206926 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:40.206839 2532 generic.go:356] "Generic (PLEG): container finished" podID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerID="c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3" exitCode=0 Sep 08 10:38:40.206926 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:40.206884 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3"} Sep 08 10:38:40.900750 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:40.900702 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Sep 08 10:38:40.945913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:40.945870 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Sep 08 10:38:41.213282 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:41.213250 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854"} Sep 08 10:38:46.234639 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:46.234598 2532 generic.go:356] "Generic (PLEG): container finished" podID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerID="611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854" exitCode=0 Sep 08 10:38:46.235109 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:46.234654 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854"} Sep 08 10:38:47.244934 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:47.244889 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224"} Sep 08 10:38:47.245446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:47.244959 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456"} Sep 08 10:38:47.245446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:47.244983 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4"} Sep 08 10:38:47.245446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:47.245004 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerStarted","Data":"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288"} Sep 08 10:38:47.292468 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:47.292392 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podStartSLOduration=13.292368055 podStartE2EDuration="13.292368055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:38:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:38:47.291222876 +0000 UTC m=+1293.177932370" watchObservedRunningTime="2026-09-08 10:38:47.292368055 +0000 UTC m=+1293.179077549" Sep 08 10:38:49.775288 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.775247 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:49.775780 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.775317 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:49.775780 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.775336 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:49.775780 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.775353 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:49.777382 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.777345 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Sep 08 10:38:49.777625 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.777362 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.19:8816: connect: connection refused" Sep 08 10:38:49.777721 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.777388 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Sep 08 10:38:49.777721 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:49.777401 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.19:6571: connect: connection refused" Sep 08 10:38:50.900690 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:50.900635 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Sep 08 10:38:50.945903 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:50.945852 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Sep 08 10:38:52.775554 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:52.775508 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.19:8816: connect: connection refused" Sep 08 10:38:52.776165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:52.775508 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Sep 08 10:38:52.776376 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:52.775509 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.19:6571: connect: connection refused" Sep 08 10:38:52.776482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:52.775545 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Sep 08 10:38:54.774827 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:54.774793 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:54.775323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:54.774862 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:54.775323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:54.774896 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:54.775323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:54.774912 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:55.776832 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:55.776797 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:55.777290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:55.776927 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:55.777290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:55.777182 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:55.782065 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:55.782043 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:56.288725 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:56.288697 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:56.288899 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:56.288769 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:56.288948 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:56.288895 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:38:56.291484 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:38:56.291467 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:39:00.900730 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:00.900677 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.18:8443: connect: connection refused" Sep 08 10:39:00.901270 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:00.900838 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:39:00.946346 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:00.946302 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" probeResult="failure" output="Get \"https://10.134.0.18:6567/health\": dial tcp 10.134.0.18:6567: connect: connection refused" Sep 08 10:39:00.946526 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:00.946430 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:39:04.321230 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.321146 2532 generic.go:356] "Generic (PLEG): container finished" podID="5b742c75-b05e-482f-8b21-0599597bf190" containerID="07946451786aa4b2135fe3bf314d21354708402d1f253cc6c20492b26715ed7b" exitCode=137 Sep 08 10:39:04.321230 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.321172 2532 generic.go:356] "Generic (PLEG): container finished" podID="5b742c75-b05e-482f-8b21-0599597bf190" containerID="4f9b02c4238976a06609d7f8c24ef299e12261bf57ccac99122bcbbbd3e19f57" exitCode=137 Sep 08 10:39:04.321230 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.321204 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"07946451786aa4b2135fe3bf314d21354708402d1f253cc6c20492b26715ed7b"} Sep 08 10:39:04.321634 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.321251 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"4f9b02c4238976a06609d7f8c24ef299e12261bf57ccac99122bcbbbd3e19f57"} Sep 08 10:39:04.555062 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.555035 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:39:04.634245 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634107 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-online-tls\") pod \"5b742c75-b05e-482f-8b21-0599597bf190\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " Sep 08 10:39:04.634245 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634212 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-ui-tls\") pod \"5b742c75-b05e-482f-8b21-0599597bf190\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " Sep 08 10:39:04.634245 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634247 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5b742c75-b05e-482f-8b21-0599597bf190-feast-data\") pod \"5b742c75-b05e-482f-8b21-0599597bf190\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " Sep 08 10:39:04.634513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634284 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn5fn\" (UniqueName: \"kubernetes.io/projected/5b742c75-b05e-482f-8b21-0599597bf190-kube-api-access-dn5fn\") pod \"5b742c75-b05e-482f-8b21-0599597bf190\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " Sep 08 10:39:04.634513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634307 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-offline-tls\") pod \"5b742c75-b05e-482f-8b21-0599597bf190\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " Sep 08 10:39:04.634513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634336 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-registry-tls\") pod \"5b742c75-b05e-482f-8b21-0599597bf190\" (UID: \"5b742c75-b05e-482f-8b21-0599597bf190\") " Sep 08 10:39:04.634908 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.634813 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b742c75-b05e-482f-8b21-0599597bf190-feast-data" (OuterVolumeSpecName: "feast-data") pod "5b742c75-b05e-482f-8b21-0599597bf190" (UID: "5b742c75-b05e-482f-8b21-0599597bf190"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:39:04.636652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.636623 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5b742c75-b05e-482f-8b21-0599597bf190" (UID: "5b742c75-b05e-482f-8b21-0599597bf190"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:39:04.636652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.636639 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-online-tls" (OuterVolumeSpecName: "online-tls") pod "5b742c75-b05e-482f-8b21-0599597bf190" (UID: "5b742c75-b05e-482f-8b21-0599597bf190"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:39:04.636807 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.636701 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5b742c75-b05e-482f-8b21-0599597bf190" (UID: "5b742c75-b05e-482f-8b21-0599597bf190"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:39:04.637028 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.637013 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b742c75-b05e-482f-8b21-0599597bf190-kube-api-access-dn5fn" (OuterVolumeSpecName: "kube-api-access-dn5fn") pod "5b742c75-b05e-482f-8b21-0599597bf190" (UID: "5b742c75-b05e-482f-8b21-0599597bf190"). InnerVolumeSpecName "kube-api-access-dn5fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:39:04.637073 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.637023 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5b742c75-b05e-482f-8b21-0599597bf190" (UID: "5b742c75-b05e-482f-8b21-0599597bf190"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:39:04.735424 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.735397 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn5fn\" (UniqueName: \"kubernetes.io/projected/5b742c75-b05e-482f-8b21-0599597bf190-kube-api-access-dn5fn\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:39:04.735424 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.735421 2532 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-offline-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:39:04.735424 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.735431 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:39:04.735652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.735440 2532 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-online-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:39:04.735652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.735447 2532 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5b742c75-b05e-482f-8b21-0599597bf190-ui-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:39:04.735652 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:04.735454 2532 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5b742c75-b05e-482f-8b21-0599597bf190-feast-data\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:39:05.328011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.327968 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" event={"ID":"5b742c75-b05e-482f-8b21-0599597bf190","Type":"ContainerDied","Data":"d47894c0093f17da8e051d7137777222dfcc194603629ee8e24e546bf2bec93e"} Sep 08 10:39:05.328011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.328014 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s" Sep 08 10:39:05.328564 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.328027 2532 scope.go:117] "RemoveContainer" containerID="6ee14ee81e4a2d1f59bee639e74c00d954fc9e41f605f6ee0f2dfcd6d24938b5" Sep 08 10:39:05.336114 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.336097 2532 scope.go:117] "RemoveContainer" containerID="07946451786aa4b2135fe3bf314d21354708402d1f253cc6c20492b26715ed7b" Sep 08 10:39:05.344002 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.343979 2532 scope.go:117] "RemoveContainer" containerID="16fdf004343e7d00bf87aede27a26b9fb4dd655735e2ca4d045ab980d334264c" Sep 08 10:39:05.351254 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.351234 2532 scope.go:117] "RemoveContainer" containerID="4f9b02c4238976a06609d7f8c24ef299e12261bf57ccac99122bcbbbd3e19f57" Sep 08 10:39:05.354873 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.354853 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s"] Sep 08 10:39:05.361231 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.361203 2532 scope.go:117] "RemoveContainer" containerID="d145032ad021e9dc8b4fb72355704a5bc506aaa18e6ee8287586e6f438154330" Sep 08 10:39:05.361544 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.361525 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qnr9s"] Sep 08 10:39:05.368244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:05.368225 2532 scope.go:117] "RemoveContainer" containerID="5b170d2c94671c8a4c1a864c082848db871aef78ab15fbd074e5cf2443db2837" Sep 08 10:39:06.660308 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:06.660272 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b742c75-b05e-482f-8b21-0599597bf190" path="/var/lib/kubelet/pods/5b742c75-b05e-482f-8b21-0599597bf190/volumes" Sep 08 10:39:58.999527 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:58.999483 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:39:59.576308 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576277 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj"] Sep 08 10:39:59.576554 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576541 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576559 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576571 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="registry" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576577 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="registry" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576584 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="offline" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576588 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="offline" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576597 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" Sep 08 10:39:59.576601 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576603 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576613 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="feast-apply" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576618 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="feast-apply" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576630 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="feast-init" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576639 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="feast-init" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576687 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="registry" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576694 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="ui" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576700 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="online" Sep 08 10:39:59.576804 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.576707 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b742c75-b05e-482f-8b21-0599597bf190" containerName="offline" Sep 08 10:39:59.579923 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.579899 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.584752 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.584729 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 10:39:59.584871 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.584853 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:39:59.585607 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.585587 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 10:39:59.585719 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.585651 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9hlg8\"" Sep 08 10:39:59.587411 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.587396 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 10:39:59.587586 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.587574 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 10:39:59.587704 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.587687 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 10:39:59.606527 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.606494 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj"] Sep 08 10:39:59.627572 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.627539 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.627713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.627577 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.627713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.627611 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx99p\" (UniqueName: \"kubernetes.io/projected/2618e8c6-d637-43e5-8d34-f1886c45bd7e-kube-api-access-wx99p\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.627713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.627672 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.627713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.627704 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2618e8c6-d637-43e5-8d34-f1886c45bd7e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.627865 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.627733 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2618e8c6-d637-43e5-8d34-f1886c45bd7e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.728758 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.728723 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.728758 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.728761 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.728983 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.728784 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx99p\" (UniqueName: \"kubernetes.io/projected/2618e8c6-d637-43e5-8d34-f1886c45bd7e-kube-api-access-wx99p\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.728983 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.728943 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.728983 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.728970 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2618e8c6-d637-43e5-8d34-f1886c45bd7e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.729159 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.728992 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2618e8c6-d637-43e5-8d34-f1886c45bd7e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.729490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.729459 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2618e8c6-d637-43e5-8d34-f1886c45bd7e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.729784 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.729755 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2618e8c6-d637-43e5-8d34-f1886c45bd7e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.731496 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.731468 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.731587 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.731508 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.731661 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.731640 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.740278 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.740255 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx99p\" (UniqueName: \"kubernetes.io/projected/2618e8c6-d637-43e5-8d34-f1886c45bd7e-kube-api-access-wx99p\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-znbrj\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:39:59.889238 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:39:59.889123 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:00.179597 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:00.179566 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj"] Sep 08 10:40:00.182565 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:40:00.182531 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2618e8c6_d637_43e5_8d34_f1886c45bd7e.slice/crio-ac7615f01bb18e77c359f07e341bb612231058ac06d5160f6fa447fb6fadbcb2 WatchSource:0}: Error finding container ac7615f01bb18e77c359f07e341bb612231058ac06d5160f6fa447fb6fadbcb2: Status 404 returned error can't find the container with id ac7615f01bb18e77c359f07e341bb612231058ac06d5160f6fa447fb6fadbcb2 Sep 08 10:40:00.353952 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:00.353914 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:40:00.529586 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:00.529504 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerStarted","Data":"43e2478625c7dc3938881288781d5674d0403d17bec1731c934ebe0b97672f35"} Sep 08 10:40:00.529586 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:00.529553 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerStarted","Data":"ac7615f01bb18e77c359f07e341bb612231058ac06d5160f6fa447fb6fadbcb2"} Sep 08 10:40:05.557677 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:05.557580 2532 generic.go:356] "Generic (PLEG): container finished" podID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerID="43e2478625c7dc3938881288781d5674d0403d17bec1731c934ebe0b97672f35" exitCode=0 Sep 08 10:40:05.557677 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:05.557662 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerDied","Data":"43e2478625c7dc3938881288781d5674d0403d17bec1731c934ebe0b97672f35"} Sep 08 10:40:06.563466 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:06.563434 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerStarted","Data":"fddd52228a3fcdf260ac8f3d8237cb8575bf71ca48c87290f84cb3c74c6ed8a7"} Sep 08 10:40:36.675371 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:36.675331 2532 generic.go:356] "Generic (PLEG): container finished" podID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerID="fddd52228a3fcdf260ac8f3d8237cb8575bf71ca48c87290f84cb3c74c6ed8a7" exitCode=0 Sep 08 10:40:36.675765 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:36.675375 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerDied","Data":"fddd52228a3fcdf260ac8f3d8237cb8575bf71ca48c87290f84cb3c74c6ed8a7"} Sep 08 10:40:37.683413 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:37.683368 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerStarted","Data":"a1ad9faffbadcd7236d99c1a35141325e0f7c1ac915770fda53849640eb9752d"} Sep 08 10:40:37.683413 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:37.683412 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerStarted","Data":"78cbf8292e98aab06e9198669341a17cbd96a73acac9a4d0a09c96b3f38b975b"} Sep 08 10:40:37.683940 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:37.683426 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerStarted","Data":"328a1205bd459d6efcd74b095b6b25bd244d96391f8bc560ca16811c141274aa"} Sep 08 10:40:37.712307 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:37.712248 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podStartSLOduration=38.712226882 podStartE2EDuration="38.712226882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:40:37.710473996 +0000 UTC m=+1403.597183490" watchObservedRunningTime="2026-09-08 10:40:37.712226882 +0000 UTC m=+1403.598936376" Sep 08 10:40:38.889705 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:38.889662 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:38.890201 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:38.889730 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:38.890201 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:38.889750 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:38.891624 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:38.891585 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 10:40:38.891624 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:38.891621 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Sep 08 10:40:38.891811 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:38.891632 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 10:40:39.889610 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:39.889565 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:39.889828 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:39.889660 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:39.889828 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:39.889697 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:41.889952 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:41.889899 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Sep 08 10:40:41.890509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:41.889899 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 10:40:41.890509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:41.889913 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 10:40:44.890071 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:44.890026 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 10:40:44.891020 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:44.891000 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:44.891123 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:44.891105 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:44.891780 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:44.891763 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:44.892091 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:44.892075 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:48.763760 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:48.763725 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:40:49.296483 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:49.296448 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:40:49.374266 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:49.374218 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:40:49.703473 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:40:49.703435 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:41:00.894286 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:00.894239 2532 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 10:41:09.770278 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:09.770236 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 08 10:41:49.769304 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:49.769250 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 08 10:41:51.905462 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:51.905426 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:41:51.952661 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:51.952623 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj"] Sep 08 10:41:51.952913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:51.952864 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" containerID="cri-o://328a1205bd459d6efcd74b095b6b25bd244d96391f8bc560ca16811c141274aa" gracePeriod=30 Sep 08 10:41:51.952982 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:51.952895 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" containerID="cri-o://a1ad9faffbadcd7236d99c1a35141325e0f7c1ac915770fda53849640eb9752d" gracePeriod=30 Sep 08 10:41:51.953036 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:51.952895 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="offline" containerID="cri-o://78cbf8292e98aab06e9198669341a17cbd96a73acac9a4d0a09c96b3f38b975b" gracePeriod=30 Sep 08 10:41:52.011481 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.011444 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:41:52.084974 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.084944 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25"] Sep 08 10:41:52.085229 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.085200 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="registry" containerID="cri-o://8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288" gracePeriod=30 Sep 08 10:41:52.085371 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.085299 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="offline" containerID="cri-o://953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456" gracePeriod=30 Sep 08 10:41:52.085371 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.085341 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" containerID="cri-o://616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4" gracePeriod=30 Sep 08 10:41:52.085497 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.085348 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" containerID="cri-o://2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224" gracePeriod=30 Sep 08 10:41:52.097664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.097641 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:41:52.165127 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.165051 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:41:52.969130 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.969105 2532 generic.go:356] "Generic (PLEG): container finished" podID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerID="a1ad9faffbadcd7236d99c1a35141325e0f7c1ac915770fda53849640eb9752d" exitCode=0 Sep 08 10:41:52.969130 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.969128 2532 generic.go:356] "Generic (PLEG): container finished" podID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerID="328a1205bd459d6efcd74b095b6b25bd244d96391f8bc560ca16811c141274aa" exitCode=0 Sep 08 10:41:52.969498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.969173 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerDied","Data":"a1ad9faffbadcd7236d99c1a35141325e0f7c1ac915770fda53849640eb9752d"} Sep 08 10:41:52.969498 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.969223 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerDied","Data":"328a1205bd459d6efcd74b095b6b25bd244d96391f8bc560ca16811c141274aa"} Sep 08 10:41:52.971744 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.971727 2532 generic.go:356] "Generic (PLEG): container finished" podID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerID="2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224" exitCode=0 Sep 08 10:41:52.971828 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:52.971765 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224"} Sep 08 10:41:53.978947 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:53.978918 2532 generic.go:356] "Generic (PLEG): container finished" podID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerID="616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4" exitCode=0 Sep 08 10:41:53.979328 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:53.978984 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4"} Sep 08 10:41:54.891909 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:54.891854 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 10:41:56.289118 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:56.289079 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Sep 08 10:41:56.289118 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:56.289070 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Sep 08 10:41:57.200444 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:57.200399 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:41:58.764773 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:41:58.764732 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 10:42:04.891836 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:04.891787 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 10:42:06.288592 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:06.288540 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Sep 08 10:42:06.289031 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:06.288600 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Sep 08 10:42:08.764766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:08.764720 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 10:42:08.765192 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:08.764870 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:42:14.892528 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:14.892483 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 10:42:14.892976 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:14.892643 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:42:16.288662 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:16.288614 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused" Sep 08 10:42:16.289124 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:16.288624 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused" Sep 08 10:42:16.289124 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:16.288785 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:42:16.289124 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:16.288854 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:42:17.957979 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:17.957932 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:18.024833 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:18.024798 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:18.765208 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:18.765167 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 10:42:22.089115 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.089077 2532 generic.go:356] "Generic (PLEG): container finished" podID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerID="78cbf8292e98aab06e9198669341a17cbd96a73acac9a4d0a09c96b3f38b975b" exitCode=137 Sep 08 10:42:22.089470 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.089121 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerDied","Data":"78cbf8292e98aab06e9198669341a17cbd96a73acac9a4d0a09c96b3f38b975b"} Sep 08 10:42:22.607480 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.607457 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:42:22.712793 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.712762 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2618e8c6-d637-43e5-8d34-f1886c45bd7e-feast-data\") pod \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " Sep 08 10:42:22.712978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.712811 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-ui-tls\") pod \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " Sep 08 10:42:22.712978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.712866 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2618e8c6-d637-43e5-8d34-f1886c45bd7e-registry-tls\") pod \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " Sep 08 10:42:22.712978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.712911 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx99p\" (UniqueName: \"kubernetes.io/projected/2618e8c6-d637-43e5-8d34-f1886c45bd7e-kube-api-access-wx99p\") pod \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " Sep 08 10:42:22.712978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.712959 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-offline-tls\") pod \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " Sep 08 10:42:22.713216 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.712988 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-online-tls\") pod \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\" (UID: \"2618e8c6-d637-43e5-8d34-f1886c45bd7e\") " Sep 08 10:42:22.713560 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.713270 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2618e8c6-d637-43e5-8d34-f1886c45bd7e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2618e8c6-d637-43e5-8d34-f1886c45bd7e" (UID: "2618e8c6-d637-43e5-8d34-f1886c45bd7e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:42:22.713560 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.713328 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2618e8c6-d637-43e5-8d34-f1886c45bd7e-feast-data" (OuterVolumeSpecName: "feast-data") pod "2618e8c6-d637-43e5-8d34-f1886c45bd7e" (UID: "2618e8c6-d637-43e5-8d34-f1886c45bd7e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:42:22.717010 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.716980 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2618e8c6-d637-43e5-8d34-f1886c45bd7e" (UID: "2618e8c6-d637-43e5-8d34-f1886c45bd7e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.717093 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.717040 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2618e8c6-d637-43e5-8d34-f1886c45bd7e" (UID: "2618e8c6-d637-43e5-8d34-f1886c45bd7e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.717093 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.717059 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2618e8c6-d637-43e5-8d34-f1886c45bd7e-kube-api-access-wx99p" (OuterVolumeSpecName: "kube-api-access-wx99p") pod "2618e8c6-d637-43e5-8d34-f1886c45bd7e" (UID: "2618e8c6-d637-43e5-8d34-f1886c45bd7e"). InnerVolumeSpecName "kube-api-access-wx99p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:42:22.717223 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.717204 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-online-tls" (OuterVolumeSpecName: "online-tls") pod "2618e8c6-d637-43e5-8d34-f1886c45bd7e" (UID: "2618e8c6-d637-43e5-8d34-f1886c45bd7e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.742864 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.742842 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:42:22.813417 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813389 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-ui-tls\") pod \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " Sep 08 10:42:22.813577 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813439 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-online-tls\") pod \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " Sep 08 10:42:22.813577 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813464 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-registry-tls\") pod \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " Sep 08 10:42:22.813577 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813489 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-offline-tls\") pod \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " Sep 08 10:42:22.813577 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813512 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llw52\" (UniqueName: \"kubernetes.io/projected/2b14dbc0-2001-40f6-b4db-8f8e312365ff-kube-api-access-llw52\") pod \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " Sep 08 10:42:22.813577 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813564 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2b14dbc0-2001-40f6-b4db-8f8e312365ff-feast-data\") pod \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\" (UID: \"2b14dbc0-2001-40f6-b4db-8f8e312365ff\") " Sep 08 10:42:22.813869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813736 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx99p\" (UniqueName: \"kubernetes.io/projected/2618e8c6-d637-43e5-8d34-f1886c45bd7e-kube-api-access-wx99p\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.813869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813755 2532 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-offline-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.813869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813768 2532 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-online-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.813869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813781 2532 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2618e8c6-d637-43e5-8d34-f1886c45bd7e-feast-data\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.813869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813792 2532 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2618e8c6-d637-43e5-8d34-f1886c45bd7e-ui-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.813869 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.813803 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2618e8c6-d637-43e5-8d34-f1886c45bd7e-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.814509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.814474 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b14dbc0-2001-40f6-b4db-8f8e312365ff-feast-data" (OuterVolumeSpecName: "feast-data") pod "2b14dbc0-2001-40f6-b4db-8f8e312365ff" (UID: "2b14dbc0-2001-40f6-b4db-8f8e312365ff"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:42:22.815713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.815682 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-online-tls" (OuterVolumeSpecName: "online-tls") pod "2b14dbc0-2001-40f6-b4db-8f8e312365ff" (UID: "2b14dbc0-2001-40f6-b4db-8f8e312365ff"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.815713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.815699 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2b14dbc0-2001-40f6-b4db-8f8e312365ff" (UID: "2b14dbc0-2001-40f6-b4db-8f8e312365ff"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.815857 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.815715 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2b14dbc0-2001-40f6-b4db-8f8e312365ff" (UID: "2b14dbc0-2001-40f6-b4db-8f8e312365ff"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.816129 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.816109 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b14dbc0-2001-40f6-b4db-8f8e312365ff-kube-api-access-llw52" (OuterVolumeSpecName: "kube-api-access-llw52") pod "2b14dbc0-2001-40f6-b4db-8f8e312365ff" (UID: "2b14dbc0-2001-40f6-b4db-8f8e312365ff"). InnerVolumeSpecName "kube-api-access-llw52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:42:22.816129 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.816111 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2b14dbc0-2001-40f6-b4db-8f8e312365ff" (UID: "2b14dbc0-2001-40f6-b4db-8f8e312365ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:42:22.914676 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.914627 2532 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2b14dbc0-2001-40f6-b4db-8f8e312365ff-feast-data\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.914676 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.914669 2532 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-ui-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.914676 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.914679 2532 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-online-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.914676 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.914687 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.914676 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.914696 2532 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2b14dbc0-2001-40f6-b4db-8f8e312365ff-offline-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:22.914985 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:22.914704 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llw52\" (UniqueName: \"kubernetes.io/projected/2b14dbc0-2001-40f6-b4db-8f8e312365ff-kube-api-access-llw52\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:23.095609 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095516 2532 generic.go:356] "Generic (PLEG): container finished" podID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerID="953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456" exitCode=137 Sep 08 10:42:23.095609 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095545 2532 generic.go:356] "Generic (PLEG): container finished" podID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerID="8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288" exitCode=137 Sep 08 10:42:23.095609 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095572 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456"} Sep 08 10:42:23.095609 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095590 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" Sep 08 10:42:23.096261 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095624 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288"} Sep 08 10:42:23.096261 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095641 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25" event={"ID":"2b14dbc0-2001-40f6-b4db-8f8e312365ff","Type":"ContainerDied","Data":"afec4f79ed86f6fee8a005cd33b36a543cc617baf8a9671fba95bf9274343c63"} Sep 08 10:42:23.096261 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.095644 2532 scope.go:117] "RemoveContainer" containerID="2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224" Sep 08 10:42:23.098604 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.098582 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" event={"ID":"2618e8c6-d637-43e5-8d34-f1886c45bd7e","Type":"ContainerDied","Data":"ac7615f01bb18e77c359f07e341bb612231058ac06d5160f6fa447fb6fadbcb2"} Sep 08 10:42:23.098728 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.098626 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj" Sep 08 10:42:23.104810 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.104791 2532 scope.go:117] "RemoveContainer" containerID="953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456" Sep 08 10:42:23.112461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.112445 2532 scope.go:117] "RemoveContainer" containerID="616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4" Sep 08 10:42:23.119640 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.119620 2532 scope.go:117] "RemoveContainer" containerID="8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288" Sep 08 10:42:23.123622 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.123600 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25"] Sep 08 10:42:23.127574 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.127551 2532 scope.go:117] "RemoveContainer" containerID="611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854" Sep 08 10:42:23.131289 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.131264 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x4d25"] Sep 08 10:42:23.134692 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.134677 2532 scope.go:117] "RemoveContainer" containerID="c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3" Sep 08 10:42:23.141368 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.141352 2532 scope.go:117] "RemoveContainer" containerID="2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224" Sep 08 10:42:23.141668 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:23.141649 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224\": container with ID starting with 2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224 not found: ID does not exist" containerID="2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224" Sep 08 10:42:23.141725 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.141675 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224"} err="failed to get container status \"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224\": rpc error: code = NotFound desc = could not find container \"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224\": container with ID starting with 2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224 not found: ID does not exist" Sep 08 10:42:23.141725 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.141705 2532 scope.go:117] "RemoveContainer" containerID="953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456" Sep 08 10:42:23.141966 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:23.141949 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456\": container with ID starting with 953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456 not found: ID does not exist" containerID="953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456" Sep 08 10:42:23.142013 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.141973 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456"} err="failed to get container status \"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456\": rpc error: code = NotFound desc = could not find container \"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456\": container with ID starting with 953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456 not found: ID does not exist" Sep 08 10:42:23.142013 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.141990 2532 scope.go:117] "RemoveContainer" containerID="616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4" Sep 08 10:42:23.142265 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:23.142247 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4\": container with ID starting with 616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4 not found: ID does not exist" containerID="616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4" Sep 08 10:42:23.142331 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.142274 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4"} err="failed to get container status \"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4\": rpc error: code = NotFound desc = could not find container \"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4\": container with ID starting with 616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4 not found: ID does not exist" Sep 08 10:42:23.142331 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.142293 2532 scope.go:117] "RemoveContainer" containerID="8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288" Sep 08 10:42:23.142536 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:23.142520 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288\": container with ID starting with 8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288 not found: ID does not exist" containerID="8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288" Sep 08 10:42:23.142571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.142540 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288"} err="failed to get container status \"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288\": rpc error: code = NotFound desc = could not find container \"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288\": container with ID starting with 8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288 not found: ID does not exist" Sep 08 10:42:23.142571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.142553 2532 scope.go:117] "RemoveContainer" containerID="611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854" Sep 08 10:42:23.142795 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:23.142781 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854\": container with ID starting with 611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854 not found: ID does not exist" containerID="611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854" Sep 08 10:42:23.142837 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.142798 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854"} err="failed to get container status \"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854\": rpc error: code = NotFound desc = could not find container \"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854\": container with ID starting with 611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854 not found: ID does not exist" Sep 08 10:42:23.142837 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.142809 2532 scope.go:117] "RemoveContainer" containerID="c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3" Sep 08 10:42:23.143015 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:23.142998 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3\": container with ID starting with c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3 not found: ID does not exist" containerID="c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3" Sep 08 10:42:23.143083 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143023 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3"} err="failed to get container status \"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3\": rpc error: code = NotFound desc = could not find container \"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3\": container with ID starting with c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3 not found: ID does not exist" Sep 08 10:42:23.143083 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143044 2532 scope.go:117] "RemoveContainer" containerID="2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224" Sep 08 10:42:23.143266 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143249 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224"} err="failed to get container status \"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224\": rpc error: code = NotFound desc = could not find container \"2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224\": container with ID starting with 2a8e3405de7a110a9a1c7749069c9f1164063ae85d75c78a72fbe1faf6188224 not found: ID does not exist" Sep 08 10:42:23.143307 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143266 2532 scope.go:117] "RemoveContainer" containerID="953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456" Sep 08 10:42:23.143482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143466 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456"} err="failed to get container status \"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456\": rpc error: code = NotFound desc = could not find container \"953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456\": container with ID starting with 953731f03735971c04ef872f3dc8478101b7b1852dd5cd79530b58b220c98456 not found: ID does not exist" Sep 08 10:42:23.143482 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143481 2532 scope.go:117] "RemoveContainer" containerID="616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4" Sep 08 10:42:23.143651 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143634 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4"} err="failed to get container status \"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4\": rpc error: code = NotFound desc = could not find container \"616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4\": container with ID starting with 616f23452f92059954c51e8b8b4b0ce9a4a253bfbc568da7b7403da0b44d61a4 not found: ID does not exist" Sep 08 10:42:23.143711 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.143653 2532 scope.go:117] "RemoveContainer" containerID="8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288" Sep 08 10:42:23.146746 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.144716 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288"} err="failed to get container status \"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288\": rpc error: code = NotFound desc = could not find container \"8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288\": container with ID starting with 8b07c578c698dbbf2f3700be6301e995498e067ed027f86bf68b8d704d1b2288 not found: ID does not exist" Sep 08 10:42:23.146746 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.144743 2532 scope.go:117] "RemoveContainer" containerID="611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854" Sep 08 10:42:23.146746 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.146686 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj"] Sep 08 10:42:23.146913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.146774 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854"} err="failed to get container status \"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854\": rpc error: code = NotFound desc = could not find container \"611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854\": container with ID starting with 611672596f1ec910444c9abbf77ba367c8633c5ab5aebd9d8a360bab3a8d9854 not found: ID does not exist" Sep 08 10:42:23.146913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.146807 2532 scope.go:117] "RemoveContainer" containerID="c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3" Sep 08 10:42:23.147358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.147338 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3"} err="failed to get container status \"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3\": rpc error: code = NotFound desc = could not find container \"c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3\": container with ID starting with c9476fe8ecaa9a412e10c1888b21daaa4db397a4110ab55874beb142359912f3 not found: ID does not exist" Sep 08 10:42:23.147358 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.147357 2532 scope.go:117] "RemoveContainer" containerID="a1ad9faffbadcd7236d99c1a35141325e0f7c1ac915770fda53849640eb9752d" Sep 08 10:42:23.151087 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.151063 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-znbrj"] Sep 08 10:42:23.155463 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.155446 2532 scope.go:117] "RemoveContainer" containerID="78cbf8292e98aab06e9198669341a17cbd96a73acac9a4d0a09c96b3f38b975b" Sep 08 10:42:23.162678 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.162662 2532 scope.go:117] "RemoveContainer" containerID="328a1205bd459d6efcd74b095b6b25bd244d96391f8bc560ca16811c141274aa" Sep 08 10:42:23.169588 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.169572 2532 scope.go:117] "RemoveContainer" containerID="fddd52228a3fcdf260ac8f3d8237cb8575bf71ca48c87290f84cb3c74c6ed8a7" Sep 08 10:42:23.176547 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:23.176531 2532 scope.go:117] "RemoveContainer" containerID="43e2478625c7dc3938881288781d5674d0403d17bec1731c934ebe0b97672f35" Sep 08 10:42:24.658108 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:24.658076 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" path="/var/lib/kubelet/pods/2618e8c6-d637-43e5-8d34-f1886c45bd7e/volumes" Sep 08 10:42:24.658603 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:24.658589 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" path="/var/lib/kubelet/pods/2b14dbc0-2001-40f6-b4db-8f8e312365ff/volumes" Sep 08 10:42:33.336359 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:33.336317 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:35.371514 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:35.371484 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:35.506472 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:35.506430 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:41.549094 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:41.549050 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:41.659084 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:41.659044 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:42:41.745894 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:41.745859 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl"] Sep 08 10:42:41.746095 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:41.746073 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" podUID="a1e7951c-76c6-4230-9bfe-177e6d55cf9f" containerName="manager" containerID="cri-o://762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9" gracePeriod=10 Sep 08 10:42:41.987113 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:41.987089 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:42:42.053668 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.053638 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb9f6\" (UniqueName: \"kubernetes.io/projected/a1e7951c-76c6-4230-9bfe-177e6d55cf9f-kube-api-access-jb9f6\") pod \"a1e7951c-76c6-4230-9bfe-177e6d55cf9f\" (UID: \"a1e7951c-76c6-4230-9bfe-177e6d55cf9f\") " Sep 08 10:42:42.055991 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.055963 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e7951c-76c6-4230-9bfe-177e6d55cf9f-kube-api-access-jb9f6" (OuterVolumeSpecName: "kube-api-access-jb9f6") pod "a1e7951c-76c6-4230-9bfe-177e6d55cf9f" (UID: "a1e7951c-76c6-4230-9bfe-177e6d55cf9f"). InnerVolumeSpecName "kube-api-access-jb9f6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:42:42.154469 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.154443 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb9f6\" (UniqueName: \"kubernetes.io/projected/a1e7951c-76c6-4230-9bfe-177e6d55cf9f-kube-api-access-jb9f6\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:42:42.172213 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.172186 2532 generic.go:356] "Generic (PLEG): container finished" podID="a1e7951c-76c6-4230-9bfe-177e6d55cf9f" containerID="762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9" exitCode=0 Sep 08 10:42:42.172312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.172234 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" Sep 08 10:42:42.172312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.172251 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" event={"ID":"a1e7951c-76c6-4230-9bfe-177e6d55cf9f","Type":"ContainerDied","Data":"762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9"} Sep 08 10:42:42.172312 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.172294 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl" event={"ID":"a1e7951c-76c6-4230-9bfe-177e6d55cf9f","Type":"ContainerDied","Data":"8b865f264b27a557459a28b7f682b3524aa10243614759784f1252f9424f1387"} Sep 08 10:42:42.172434 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.172316 2532 scope.go:117] "RemoveContainer" containerID="762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9" Sep 08 10:42:42.180205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.180186 2532 scope.go:117] "RemoveContainer" containerID="762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9" Sep 08 10:42:42.180506 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:42:42.180488 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9\": container with ID starting with 762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9 not found: ID does not exist" containerID="762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9" Sep 08 10:42:42.180571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.180519 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9"} err="failed to get container status \"762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9\": rpc error: code = NotFound desc = could not find container \"762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9\": container with ID starting with 762d9bb1e111df8057f034b1f33ea2d89ea85d9bfe4c20bcbff81e804831fea9 not found: ID does not exist" Sep 08 10:42:42.192692 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.192663 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl"] Sep 08 10:42:42.196471 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.196453 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-8fsxl"] Sep 08 10:42:42.658486 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:42.658446 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e7951c-76c6-4230-9bfe-177e6d55cf9f" path="/var/lib/kubelet/pods/a1e7951c-76c6-4230-9bfe-177e6d55cf9f/volumes" Sep 08 10:42:46.812865 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.812833 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr"] Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813067 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="registry" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813079 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="registry" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813087 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="offline" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813093 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="offline" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813102 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813108 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813116 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e7951c-76c6-4230-9bfe-177e6d55cf9f" containerName="manager" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813121 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e7951c-76c6-4230-9bfe-177e6d55cf9f" containerName="manager" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813127 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="feast-apply" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813148 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="feast-apply" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813155 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="feast-init" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813160 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="feast-init" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813168 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813173 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813180 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="feast-init" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813185 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="feast-init" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813190 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813195 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813203 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="offline" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813207 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="offline" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813214 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813219 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813225 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="feast-apply" Sep 08 10:42:46.813244 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813230 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="feast-apply" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813271 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1e7951c-76c6-4230-9bfe-177e6d55cf9f" containerName="manager" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813277 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="offline" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813283 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="online" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813289 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2618e8c6-d637-43e5-8d34-f1886c45bd7e" containerName="ui" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813294 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="offline" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813299 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="registry" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813303 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="online" Sep 08 10:42:46.813978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.813307 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b14dbc0-2001-40f6-b4db-8f8e312365ff" containerName="ui" Sep 08 10:42:46.815887 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.815872 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:42:46.819914 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.819895 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 10:42:46.820659 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.820642 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-g6vgr\"" Sep 08 10:42:46.820744 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.820665 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 10:42:46.828171 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.828125 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr"] Sep 08 10:42:46.886866 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.886831 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25bt5\" (UniqueName: \"kubernetes.io/projected/942b9088-8904-4aa2-8289-870dd78da3f9-kube-api-access-25bt5\") pod \"feast-operator-controller-manager-689b877b4b-5dxpr\" (UID: \"942b9088-8904-4aa2-8289-870dd78da3f9\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:42:46.988282 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:46.988236 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25bt5\" (UniqueName: \"kubernetes.io/projected/942b9088-8904-4aa2-8289-870dd78da3f9-kube-api-access-25bt5\") pod \"feast-operator-controller-manager-689b877b4b-5dxpr\" (UID: \"942b9088-8904-4aa2-8289-870dd78da3f9\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:42:47.005343 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:47.005318 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25bt5\" (UniqueName: \"kubernetes.io/projected/942b9088-8904-4aa2-8289-870dd78da3f9-kube-api-access-25bt5\") pod \"feast-operator-controller-manager-689b877b4b-5dxpr\" (UID: \"942b9088-8904-4aa2-8289-870dd78da3f9\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:42:47.126237 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:47.126107 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:42:47.407747 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:47.407718 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr"] Sep 08 10:42:47.411896 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:42:47.411869 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942b9088_8904_4aa2_8289_870dd78da3f9.slice/crio-89bb1250bb859758a0aa07d4e8884a6467b1a60e0c1e30146496582aaf761a8d WatchSource:0}: Error finding container 89bb1250bb859758a0aa07d4e8884a6467b1a60e0c1e30146496582aaf761a8d: Status 404 returned error can't find the container with id 89bb1250bb859758a0aa07d4e8884a6467b1a60e0c1e30146496582aaf761a8d Sep 08 10:42:48.196844 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:48.196802 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" event={"ID":"942b9088-8904-4aa2-8289-870dd78da3f9","Type":"ContainerStarted","Data":"fa9c3ca74f7dc773b99c5b345827bb1c0cee8494426ebff93a1b2894375c1713"} Sep 08 10:42:48.197260 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:48.196853 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" event={"ID":"942b9088-8904-4aa2-8289-870dd78da3f9","Type":"ContainerStarted","Data":"89bb1250bb859758a0aa07d4e8884a6467b1a60e0c1e30146496582aaf761a8d"} Sep 08 10:42:48.197260 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:48.196899 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:42:48.223615 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:48.223554 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" podStartSLOduration=2.22353269 podStartE2EDuration="2.22353269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:42:48.222600878 +0000 UTC m=+1534.109310370" watchObservedRunningTime="2026-09-08 10:42:48.22353269 +0000 UTC m=+1534.110242184" Sep 08 10:42:59.203163 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:42:59.203105 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-5dxpr" Sep 08 10:43:03.159118 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:03.159082 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:03.259835 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:03.259788 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:05.989487 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:05.989453 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:06.088432 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.088381 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:06.185978 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.185946 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:06.193500 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.193469 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl"] Sep 08 10:43:06.197420 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.197397 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.200674 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.200658 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 10:43:06.200764 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.200662 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 10:43:06.202756 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.202738 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 10:43:06.203914 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.203544 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 10:43:06.203914 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.203568 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 10:43:06.203914 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.203788 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-qwv4b\"" Sep 08 10:43:06.204211 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.204193 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 10:43:06.216043 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.216017 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl"] Sep 08 10:43:06.328506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.328425 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm76m\" (UniqueName: \"kubernetes.io/projected/e1b873f0-604f-4894-b276-44388a3decca-kube-api-access-rm76m\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.328506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.328464 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.328506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.328486 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.328713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.328543 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.328713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.328572 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b873f0-604f-4894-b276-44388a3decca-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.328713 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.328609 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.399643 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.399605 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:06.429630 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.429590 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm76m\" (UniqueName: \"kubernetes.io/projected/e1b873f0-604f-4894-b276-44388a3decca-kube-api-access-rm76m\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.429630 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.429631 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.429834 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.429648 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.429834 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.429683 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.429834 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.429699 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b873f0-604f-4894-b276-44388a3decca-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.429834 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.429721 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.430030 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:43:06.429932 2532 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:43:06.430030 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:43:06.430025 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls podName:e1b873f0-604f-4894-b276-44388a3decca nodeName:}" failed. No retries permitted until 2026-09-08 10:43:06.930003028 +0000 UTC m=+1552.816712517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-tpwcl" (UID: "e1b873f0-604f-4894-b276-44388a3decca") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 10:43:06.430175 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.430112 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b873f0-604f-4894-b276-44388a3decca-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.432536 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.432514 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.432647 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.432568 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.432647 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.432617 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.440567 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.440547 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm76m\" (UniqueName: \"kubernetes.io/projected/e1b873f0-604f-4894-b276-44388a3decca-kube-api-access-rm76m\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.645704 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.645617 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:43:06.933353 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.933319 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:06.935845 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:06.935824 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tpwcl\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:07.106645 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:07.106604 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:07.387469 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:43:07.387445 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1b873f0_604f_4894_b276_44388a3decca.slice/crio-48132e53e872c255a5e85519c1754818abb9491b547b3968e054e665b682b45d WatchSource:0}: Error finding container 48132e53e872c255a5e85519c1754818abb9491b547b3968e054e665b682b45d: Status 404 returned error can't find the container with id 48132e53e872c255a5e85519c1754818abb9491b547b3968e054e665b682b45d Sep 08 10:43:07.391442 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:07.391420 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl"] Sep 08 10:43:08.267532 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:08.267490 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"f0a4494ca5753babff94b45bf29209001750d3be6d62b9b10826c12d936bb2c0"} Sep 08 10:43:08.267886 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:08.267550 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"48132e53e872c255a5e85519c1754818abb9491b547b3968e054e665b682b45d"} Sep 08 10:43:12.285397 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:12.285367 2532 generic.go:356] "Generic (PLEG): container finished" podID="e1b873f0-604f-4894-b276-44388a3decca" containerID="f0a4494ca5753babff94b45bf29209001750d3be6d62b9b10826c12d936bb2c0" exitCode=0 Sep 08 10:43:12.285767 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:12.285413 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"f0a4494ca5753babff94b45bf29209001750d3be6d62b9b10826c12d936bb2c0"} Sep 08 10:43:13.291011 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:13.290975 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"325bc828881147e1d698b18ae8c05f62323c678e0e625a6eaf4c860b74a5f135"} Sep 08 10:43:18.309509 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:18.309471 2532 generic.go:356] "Generic (PLEG): container finished" podID="e1b873f0-604f-4894-b276-44388a3decca" containerID="325bc828881147e1d698b18ae8c05f62323c678e0e625a6eaf4c860b74a5f135" exitCode=0 Sep 08 10:43:18.309878 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:18.309517 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"325bc828881147e1d698b18ae8c05f62323c678e0e625a6eaf4c860b74a5f135"} Sep 08 10:43:19.319748 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:19.319703 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"446b268c5e87a279023e2c7cb84a8398836a0cf4350b6cecd9c84df9f739a54b"} Sep 08 10:43:19.320271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:19.319767 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"bbd15e7b9ff9af16226cf83f35914fe73f327b8750be59d5c98e6e848d8111ed"} Sep 08 10:43:19.320271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:19.319788 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"f9d54b51a45ccd84fe437a5458be48cee8ec531d04e893bd03f24676b153081b"} Sep 08 10:43:19.320271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:19.319806 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerStarted","Data":"dca365daec4a70f2754ba750b4abc21dd082d5548d8215228d1eb0ad6db84244"} Sep 08 10:43:19.361150 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:19.361078 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podStartSLOduration=13.361055023 podStartE2EDuration="13.361055023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:43:19.360657187 +0000 UTC m=+1565.247366724" watchObservedRunningTime="2026-09-08 10:43:19.361055023 +0000 UTC m=+1565.247764517" Sep 08 10:43:22.107755 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.107677 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:22.107755 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.107758 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:22.108353 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.107781 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:22.108353 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.107798 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:22.110177 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.110118 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 10:43:22.110316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.110192 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 10:43:22.110316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.110126 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused" Sep 08 10:43:22.110446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:22.110152 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused" Sep 08 10:43:25.107497 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:25.107443 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused" Sep 08 10:43:25.107990 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:25.107539 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 10:43:25.107990 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:25.107446 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 10:43:25.107990 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:25.107445 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused" Sep 08 10:43:27.106696 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:27.106660 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:27.107183 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:27.106716 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:27.107183 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:27.106733 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:27.107183 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:27.106752 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.108232 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.108201 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.108614 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.108300 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.108614 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.108505 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.113262 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.113247 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.368936 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.368854 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.369575 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.369544 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.370430 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.370410 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:43:28.372367 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:43:28.372347 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:44:30.268013 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.267974 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:30.291314 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.291277 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl"] Sep 08 10:44:30.291582 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.291551 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" containerID="cri-o://f9d54b51a45ccd84fe437a5458be48cee8ec531d04e893bd03f24676b153081b" gracePeriod=30 Sep 08 10:44:30.291582 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.291553 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="registry" containerID="cri-o://dca365daec4a70f2754ba750b4abc21dd082d5548d8215228d1eb0ad6db84244" gracePeriod=30 Sep 08 10:44:30.291726 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.291559 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="offline" containerID="cri-o://bbd15e7b9ff9af16226cf83f35914fe73f327b8750be59d5c98e6e848d8111ed" gracePeriod=30 Sep 08 10:44:30.291726 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.291625 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" containerID="cri-o://446b268c5e87a279023e2c7cb84a8398836a0cf4350b6cecd9c84df9f739a54b" gracePeriod=30 Sep 08 10:44:30.362334 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.362300 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:30.570895 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.570795 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:30.669724 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.669680 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:30.785699 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.785663 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:30.813847 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.813806 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2"] Sep 08 10:44:30.824419 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.824336 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:30.827892 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.827864 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-z9mjh\"" Sep 08 10:44:30.838302 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.838270 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2"] Sep 08 10:44:30.903430 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.903394 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:30.929311 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.929275 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:30.929489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.929321 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmh7\" (UniqueName: \"kubernetes.io/projected/25810de6-780f-4685-a846-301f69e32a35-kube-api-access-smmh7\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:30.929489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.929415 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:30.929489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.929438 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25810de6-780f-4685-a846-301f69e32a35-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:30.929489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.929463 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:30.929489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:30.929484 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.030666 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.030625 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.030666 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.030664 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25810de6-780f-4685-a846-301f69e32a35-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.030905 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.030693 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.030905 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.030721 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.030905 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.030752 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.030905 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.030782 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmh7\" (UniqueName: \"kubernetes.io/projected/25810de6-780f-4685-a846-301f69e32a35-kube-api-access-smmh7\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.031092 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:44:31.030899 2532 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:44:31.031092 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:44:31.030976 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls podName:25810de6-780f-4685-a846-301f69e32a35 nodeName:}" failed. No retries permitted until 2026-09-08 10:44:31.530953936 +0000 UTC m=+1637.417663440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-vcdz2" (UID: "25810de6-780f-4685-a846-301f69e32a35") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:44:31.031092 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.031052 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25810de6-780f-4685-a846-301f69e32a35-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.033325 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.033302 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.033461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.033327 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.033527 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.033512 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.041450 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.041419 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmh7\" (UniqueName: \"kubernetes.io/projected/25810de6-780f-4685-a846-301f69e32a35-kube-api-access-smmh7\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.080420 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.080386 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:31.534572 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.534534 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:31.534954 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:44:31.534651 2532 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:44:31.534954 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:44:31.534703 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls podName:25810de6-780f-4685-a846-301f69e32a35 nodeName:}" failed. No retries permitted until 2026-09-08 10:44:32.534689052 +0000 UTC m=+1638.421398522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-vcdz2" (UID: "25810de6-780f-4685-a846-301f69e32a35") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 10:44:31.601258 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.601225 2532 generic.go:356] "Generic (PLEG): container finished" podID="e1b873f0-604f-4894-b276-44388a3decca" containerID="446b268c5e87a279023e2c7cb84a8398836a0cf4350b6cecd9c84df9f739a54b" exitCode=0 Sep 08 10:44:31.601258 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.601250 2532 generic.go:356] "Generic (PLEG): container finished" podID="e1b873f0-604f-4894-b276-44388a3decca" containerID="f9d54b51a45ccd84fe437a5458be48cee8ec531d04e893bd03f24676b153081b" exitCode=0 Sep 08 10:44:31.601446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.601294 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"446b268c5e87a279023e2c7cb84a8398836a0cf4350b6cecd9c84df9f739a54b"} Sep 08 10:44:31.601446 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.601339 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"f9d54b51a45ccd84fe437a5458be48cee8ec531d04e893bd03f24676b153081b"} Sep 08 10:44:31.732026 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:31.731978 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:44:32.541271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:32.541230 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:32.543782 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:32.543726 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-vcdz2\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:32.634328 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:32.634299 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:32.927656 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:32.927634 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2"] Sep 08 10:44:32.930302 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:44:32.930264 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25810de6_780f_4685_a846_301f69e32a35.slice/crio-dfa2342c180468d898805aae2b9e6f0b93416236f2e6f06f451a18b6f480f406 WatchSource:0}: Error finding container dfa2342c180468d898805aae2b9e6f0b93416236f2e6f06f451a18b6f480f406: Status 404 returned error can't find the container with id dfa2342c180468d898805aae2b9e6f0b93416236f2e6f06f451a18b6f480f406 Sep 08 10:44:33.610842 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:33.610800 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045"} Sep 08 10:44:33.611256 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:33.610855 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"dfa2342c180468d898805aae2b9e6f0b93416236f2e6f06f451a18b6f480f406"} Sep 08 10:44:38.368307 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:38.368260 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 10:44:38.368307 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:38.368270 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 10:44:38.634605 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:38.634514 2532 generic.go:356] "Generic (PLEG): container finished" podID="25810de6-780f-4685-a846-301f69e32a35" containerID="ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045" exitCode=0 Sep 08 10:44:38.634751 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:38.634595 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045"} Sep 08 10:44:39.639960 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:39.639927 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84"} Sep 08 10:44:44.664547 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:44.664506 2532 generic.go:356] "Generic (PLEG): container finished" podID="25810de6-780f-4685-a846-301f69e32a35" containerID="72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84" exitCode=0 Sep 08 10:44:44.664934 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:44.664579 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84"} Sep 08 10:44:45.675071 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:45.675034 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842"} Sep 08 10:44:45.675711 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:45.675666 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8"} Sep 08 10:44:45.675875 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:45.675856 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033"} Sep 08 10:44:45.676119 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:45.676084 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerStarted","Data":"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab"} Sep 08 10:44:45.719781 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:45.719704 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podStartSLOduration=15.719682545 podStartE2EDuration="15.719682545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:44:45.714908427 +0000 UTC m=+1651.601617945" watchObservedRunningTime="2026-09-08 10:44:45.719682545 +0000 UTC m=+1651.606392039" Sep 08 10:44:47.635086 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.635033 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:47.635597 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.635101 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:47.635597 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.635121 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:47.635597 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.635279 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:47.637221 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.637176 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Sep 08 10:44:47.637454 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.637263 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Sep 08 10:44:47.637538 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.637266 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused" Sep 08 10:44:47.637602 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:47.637318 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Sep 08 10:44:48.368147 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:48.368078 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 10:44:48.368355 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:48.368314 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 10:44:50.635588 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:50.635543 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused" Sep 08 10:44:50.636189 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:50.635543 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused" Sep 08 10:44:50.636290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:50.635562 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Sep 08 10:44:50.636290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:50.635776 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Sep 08 10:44:52.635129 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:52.635088 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:52.635508 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:52.635190 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:52.635508 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:52.635218 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:52.635508 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:52.635236 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.635582 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.635545 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.636090 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.636068 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.636290 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.636270 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.636384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.636336 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.641078 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.641058 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.714592 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.714566 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.714780 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.714634 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:53.717357 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:53.717335 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:44:58.368246 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:58.368204 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 10:44:58.368692 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:58.368199 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 10:44:58.368692 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:58.368373 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:44:58.368692 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:44:58.368454 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:45:00.742858 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:00.742825 2532 generic.go:356] "Generic (PLEG): container finished" podID="e1b873f0-604f-4894-b276-44388a3decca" containerID="bbd15e7b9ff9af16226cf83f35914fe73f327b8750be59d5c98e6e848d8111ed" exitCode=137 Sep 08 10:45:00.742858 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:00.742853 2532 generic.go:356] "Generic (PLEG): container finished" podID="e1b873f0-604f-4894-b276-44388a3decca" containerID="dca365daec4a70f2754ba750b4abc21dd082d5548d8215228d1eb0ad6db84244" exitCode=137 Sep 08 10:45:00.743284 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:00.742898 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"bbd15e7b9ff9af16226cf83f35914fe73f327b8750be59d5c98e6e848d8111ed"} Sep 08 10:45:00.743284 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:00.742937 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"dca365daec4a70f2754ba750b4abc21dd082d5548d8215228d1eb0ad6db84244"} Sep 08 10:45:00.938075 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:00.938048 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:45:01.069227 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069105 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm76m\" (UniqueName: \"kubernetes.io/projected/e1b873f0-604f-4894-b276-44388a3decca-kube-api-access-rm76m\") pod \"e1b873f0-604f-4894-b276-44388a3decca\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " Sep 08 10:45:01.069227 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069185 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b873f0-604f-4894-b276-44388a3decca-feast-data\") pod \"e1b873f0-604f-4894-b276-44388a3decca\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " Sep 08 10:45:01.069227 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069210 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls\") pod \"e1b873f0-604f-4894-b276-44388a3decca\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " Sep 08 10:45:01.069495 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069248 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-registry-tls\") pod \"e1b873f0-604f-4894-b276-44388a3decca\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " Sep 08 10:45:01.069495 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069276 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-offline-tls\") pod \"e1b873f0-604f-4894-b276-44388a3decca\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " Sep 08 10:45:01.069495 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069353 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-online-tls\") pod \"e1b873f0-604f-4894-b276-44388a3decca\" (UID: \"e1b873f0-604f-4894-b276-44388a3decca\") " Sep 08 10:45:01.069742 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.069711 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1b873f0-604f-4894-b276-44388a3decca-feast-data" (OuterVolumeSpecName: "feast-data") pod "e1b873f0-604f-4894-b276-44388a3decca" (UID: "e1b873f0-604f-4894-b276-44388a3decca"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:45:01.071624 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.071591 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b873f0-604f-4894-b276-44388a3decca-kube-api-access-rm76m" (OuterVolumeSpecName: "kube-api-access-rm76m") pod "e1b873f0-604f-4894-b276-44388a3decca" (UID: "e1b873f0-604f-4894-b276-44388a3decca"). InnerVolumeSpecName "kube-api-access-rm76m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:45:01.071954 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.071926 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e1b873f0-604f-4894-b276-44388a3decca" (UID: "e1b873f0-604f-4894-b276-44388a3decca"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:45:01.071954 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.071943 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e1b873f0-604f-4894-b276-44388a3decca" (UID: "e1b873f0-604f-4894-b276-44388a3decca"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:45:01.072073 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.072053 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1b873f0-604f-4894-b276-44388a3decca" (UID: "e1b873f0-604f-4894-b276-44388a3decca"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:45:01.072154 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.072113 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-online-tls" (OuterVolumeSpecName: "online-tls") pod "e1b873f0-604f-4894-b276-44388a3decca" (UID: "e1b873f0-604f-4894-b276-44388a3decca"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:45:01.170384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.170347 2532 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-offline-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:45:01.170384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.170374 2532 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-online-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:45:01.170384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.170383 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm76m\" (UniqueName: \"kubernetes.io/projected/e1b873f0-604f-4894-b276-44388a3decca-kube-api-access-rm76m\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:45:01.170384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.170393 2532 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1b873f0-604f-4894-b276-44388a3decca-feast-data\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:45:01.170384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.170402 2532 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-ui-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:45:01.170676 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.170409 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1b873f0-604f-4894-b276-44388a3decca-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:45:01.749911 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.749876 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" event={"ID":"e1b873f0-604f-4894-b276-44388a3decca","Type":"ContainerDied","Data":"48132e53e872c255a5e85519c1754818abb9491b547b3968e054e665b682b45d"} Sep 08 10:45:01.750428 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.749935 2532 scope.go:117] "RemoveContainer" containerID="446b268c5e87a279023e2c7cb84a8398836a0cf4350b6cecd9c84df9f739a54b" Sep 08 10:45:01.750428 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.749954 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl" Sep 08 10:45:01.758369 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.758297 2532 scope.go:117] "RemoveContainer" containerID="bbd15e7b9ff9af16226cf83f35914fe73f327b8750be59d5c98e6e848d8111ed" Sep 08 10:45:01.766061 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.766043 2532 scope.go:117] "RemoveContainer" containerID="f9d54b51a45ccd84fe437a5458be48cee8ec531d04e893bd03f24676b153081b" Sep 08 10:45:01.773456 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.773437 2532 scope.go:117] "RemoveContainer" containerID="dca365daec4a70f2754ba750b4abc21dd082d5548d8215228d1eb0ad6db84244" Sep 08 10:45:01.781079 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.781060 2532 scope.go:117] "RemoveContainer" containerID="325bc828881147e1d698b18ae8c05f62323c678e0e625a6eaf4c860b74a5f135" Sep 08 10:45:01.786826 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.786790 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl"] Sep 08 10:45:01.790506 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.790485 2532 scope.go:117] "RemoveContainer" containerID="f0a4494ca5753babff94b45bf29209001750d3be6d62b9b10826c12d936bb2c0" Sep 08 10:45:01.791080 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:01.791058 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tpwcl"] Sep 08 10:45:02.658071 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:02.658029 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b873f0-604f-4894-b276-44388a3decca" path="/var/lib/kubelet/pods/e1b873f0-604f-4894-b276-44388a3decca/volumes" Sep 08 10:45:54.831705 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:54.831673 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:45:55.303657 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.303620 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5"] Sep 08 10:45:55.303983 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.303948 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="feast-apply" Sep 08 10:45:55.303983 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.303981 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="feast-apply" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.303993 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="registry" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.303999 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="registry" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304006 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304012 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304025 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="feast-init" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304030 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="feast-init" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304038 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304046 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304059 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="offline" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304067 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="offline" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304120 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="online" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304149 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="offline" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304158 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="registry" Sep 08 10:45:55.304167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.304166 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b873f0-604f-4894-b276-44388a3decca" containerName="ui" Sep 08 10:45:55.307461 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.307446 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.310167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.310126 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 10:45:55.310167 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.310156 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 10:45:55.310332 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.310186 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 10:45:55.310332 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.310296 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 10:45:55.310949 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.310934 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 10:45:55.310993 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.310936 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-kwh5f\"" Sep 08 10:45:55.311239 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.311225 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 10:45:55.320493 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.320472 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5"] Sep 08 10:45:55.359499 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.359471 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4bed5560-9ba4-4520-9cf3-98620fe5682d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.359499 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.359501 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.359711 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.359522 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wczp\" (UniqueName: \"kubernetes.io/projected/4bed5560-9ba4-4520-9cf3-98620fe5682d-kube-api-access-8wczp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.359711 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.359550 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bed5560-9ba4-4520-9cf3-98620fe5682d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.359711 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.359616 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.359711 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.359669 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.460501 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.460461 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.460697 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.460532 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4bed5560-9ba4-4520-9cf3-98620fe5682d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.460697 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.460560 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.460697 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.460585 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wczp\" (UniqueName: \"kubernetes.io/projected/4bed5560-9ba4-4520-9cf3-98620fe5682d-kube-api-access-8wczp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.460860 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:45:55.460700 2532 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 08 10:45:55.460860 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.460715 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bed5560-9ba4-4520-9cf3-98620fe5682d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.460860 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:45:55.460766 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls podName:4bed5560-9ba4-4520-9cf3-98620fe5682d nodeName:}" failed. No retries permitted until 2026-09-08 10:45:55.960747091 +0000 UTC m=+1721.847456561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 08 10:45:55.460860 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.460800 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.461070 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:45:55.460893 2532 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 10:45:55.461070 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:45:55.460936 2532 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls podName:4bed5560-9ba4-4520-9cf3-98620fe5682d nodeName:}" failed. No retries permitted until 2026-09-08 10:45:55.960922841 +0000 UTC m=+1721.847632326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 08 10:45:55.461188 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.461072 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bed5560-9ba4-4520-9cf3-98620fe5682d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.461322 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.461306 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4bed5560-9ba4-4520-9cf3-98620fe5682d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.463321 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.463294 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.469998 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.469973 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wczp\" (UniqueName: \"kubernetes.io/projected/4bed5560-9ba4-4520-9cf3-98620fe5682d-kube-api-access-8wczp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.964735 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.964693 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.965126 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.964768 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.967281 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.967258 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:55.967395 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:55.967301 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v5vz5\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:56.217271 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:56.217171 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:45:56.500841 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:56.500814 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5"] Sep 08 10:45:56.502899 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:45:56.502865 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bed5560_9ba4_4520_9cf3_98620fe5682d.slice/crio-b9e9a243054af427ac76dd2bd64fcabd2d926c06135065e1b0981717d0995cf8 WatchSource:0}: Error finding container b9e9a243054af427ac76dd2bd64fcabd2d926c06135065e1b0981717d0995cf8: Status 404 returned error can't find the container with id b9e9a243054af427ac76dd2bd64fcabd2d926c06135065e1b0981717d0995cf8 Sep 08 10:45:56.517826 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:56.517779 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:45:56.948045 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:56.948005 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerStarted","Data":"be0636d2ef3a663115d0e2bff3e4b446fa92b1c4f6e6b899b313b3a9f67b0db4"} Sep 08 10:45:56.948282 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:45:56.948062 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerStarted","Data":"b9e9a243054af427ac76dd2bd64fcabd2d926c06135065e1b0981717d0995cf8"} Sep 08 10:46:01.973812 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:01.973767 2532 generic.go:356] "Generic (PLEG): container finished" podID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerID="be0636d2ef3a663115d0e2bff3e4b446fa92b1c4f6e6b899b313b3a9f67b0db4" exitCode=0 Sep 08 10:46:01.974234 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:01.973843 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerDied","Data":"be0636d2ef3a663115d0e2bff3e4b446fa92b1c4f6e6b899b313b3a9f67b0db4"} Sep 08 10:46:02.979699 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:02.979661 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerStarted","Data":"3ba7014067f589a9fd01080017fb5fb06158a50e309c1ed1c6066ab29e3f834b"} Sep 08 10:46:29.086432 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:29.086390 2532 generic.go:356] "Generic (PLEG): container finished" podID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerID="3ba7014067f589a9fd01080017fb5fb06158a50e309c1ed1c6066ab29e3f834b" exitCode=0 Sep 08 10:46:29.086826 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:29.086433 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerDied","Data":"3ba7014067f589a9fd01080017fb5fb06158a50e309c1ed1c6066ab29e3f834b"} Sep 08 10:46:30.095080 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:30.095041 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerStarted","Data":"c759f37c9f1e8debcb62a3e04bd2aed3bc3c01feacae6e6f8c688d583fdae5cf"} Sep 08 10:46:30.095476 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:30.095103 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerStarted","Data":"f20354ce80200aa964171558c58cf383f5730224f6527365b6592377937cda3e"} Sep 08 10:46:30.095476 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:30.095124 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerStarted","Data":"b5f08e859b64a57e28777be75244abf17aa4dfb9af45852267e8512316c973a3"} Sep 08 10:46:30.134466 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:30.134399 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podStartSLOduration=35.134376024 podStartE2EDuration="35.134376024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:45:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:46:30.132974872 +0000 UTC m=+1756.019684367" watchObservedRunningTime="2026-09-08 10:46:30.134376024 +0000 UTC m=+1756.021085519" Sep 08 10:46:32.218081 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:32.218022 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:32.218489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:32.218092 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:32.218489 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:32.218111 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:32.219997 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:32.219965 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Sep 08 10:46:32.220151 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:32.220025 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 08 10:46:32.220151 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:32.219986 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 08 10:46:35.218513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:35.218463 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused" Sep 08 10:46:35.218513 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:35.218495 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 08 10:46:35.219202 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:35.218463 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 08 10:46:36.217624 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:36.217583 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:36.217856 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:36.217705 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:36.217856 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:36.217760 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:38.218316 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:38.218289 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:38.218805 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:38.218411 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:38.219037 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:38.219016 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:38.219217 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:38.219199 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:39.218392 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:39.218349 2532 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 08 10:46:42.117259 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:42.117224 2532 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:46:43.080064 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:46:43.080036 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:47:45.453182 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.453126 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5"] Sep 08 10:47:45.453731 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.453456 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" containerID="cri-o://b5f08e859b64a57e28777be75244abf17aa4dfb9af45852267e8512316c973a3" gracePeriod=30 Sep 08 10:47:45.453731 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.453489 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="offline" containerID="cri-o://f20354ce80200aa964171558c58cf383f5730224f6527365b6592377937cda3e" gracePeriod=30 Sep 08 10:47:45.453731 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.453483 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" containerID="cri-o://c759f37c9f1e8debcb62a3e04bd2aed3bc3c01feacae6e6f8c688d583fdae5cf" gracePeriod=30 Sep 08 10:47:45.582233 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.582204 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:47:45.600494 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.600459 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2"] Sep 08 10:47:45.600785 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.600753 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="registry" containerID="cri-o://48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab" gracePeriod=30 Sep 08 10:47:45.600912 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.600827 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" containerID="cri-o://e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842" gracePeriod=30 Sep 08 10:47:45.600912 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.600888 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="offline" containerID="cri-o://ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8" gracePeriod=30 Sep 08 10:47:45.601033 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.600928 2532 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" containerID="cri-o://55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033" gracePeriod=30 Sep 08 10:47:45.680417 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.680375 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:47:45.781123 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:45.781001 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:47:46.401614 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:46.401582 2532 generic.go:356] "Generic (PLEG): container finished" podID="25810de6-780f-4685-a846-301f69e32a35" containerID="e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842" exitCode=0 Sep 08 10:47:46.401738 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:46.401652 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842"} Sep 08 10:47:46.404383 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:46.404362 2532 generic.go:356] "Generic (PLEG): container finished" podID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerID="c759f37c9f1e8debcb62a3e04bd2aed3bc3c01feacae6e6f8c688d583fdae5cf" exitCode=0 Sep 08 10:47:46.404474 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:46.404436 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerDied","Data":"c759f37c9f1e8debcb62a3e04bd2aed3bc3c01feacae6e6f8c688d583fdae5cf"} Sep 08 10:47:47.410729 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:47.410692 2532 generic.go:356] "Generic (PLEG): container finished" podID="25810de6-780f-4685-a846-301f69e32a35" containerID="55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033" exitCode=0 Sep 08 10:47:47.411196 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:47.410762 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033"} Sep 08 10:47:47.413378 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:47.413357 2532 generic.go:356] "Generic (PLEG): container finished" podID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerID="b5f08e859b64a57e28777be75244abf17aa4dfb9af45852267e8512316c973a3" exitCode=0 Sep 08 10:47:47.413486 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:47.413424 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerDied","Data":"b5f08e859b64a57e28777be75244abf17aa4dfb9af45852267e8512316c973a3"} Sep 08 10:47:48.219654 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:48.219609 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 08 10:47:50.764714 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:50.764680 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:47:52.118306 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:52.118262 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 08 10:47:53.714903 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:53.714855 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Sep 08 10:47:53.715384 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:53.714870 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Sep 08 10:47:58.219560 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:47:58.219508 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 08 10:48:02.118323 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:02.118276 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 08 10:48:03.714880 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:03.714838 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Sep 08 10:48:03.715315 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:03.714843 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Sep 08 10:48:08.219805 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:08.219758 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused" Sep 08 10:48:08.220230 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:08.219909 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:48:12.118606 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:12.118563 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused" Sep 08 10:48:12.118970 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:12.118684 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:48:13.714980 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:13.714936 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused" Sep 08 10:48:13.715430 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:13.714986 2532 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused" Sep 08 10:48:13.715430 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:13.715072 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:48:13.715430 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:13.715129 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:48:15.518571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:15.518540 2532 generic.go:356] "Generic (PLEG): container finished" podID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerID="f20354ce80200aa964171558c58cf383f5730224f6527365b6592377937cda3e" exitCode=137 Sep 08 10:48:15.518883 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:15.518608 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerDied","Data":"f20354ce80200aa964171558c58cf383f5730224f6527365b6592377937cda3e"} Sep 08 10:48:16.097787 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.097761 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:48:16.200589 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.200552 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-online-tls\") pod \"4bed5560-9ba4-4520-9cf3-98620fe5682d\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " Sep 08 10:48:16.200589 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.200588 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls\") pod \"4bed5560-9ba4-4520-9cf3-98620fe5682d\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " Sep 08 10:48:16.200768 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.200620 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bed5560-9ba4-4520-9cf3-98620fe5682d-feast-data\") pod \"4bed5560-9ba4-4520-9cf3-98620fe5682d\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " Sep 08 10:48:16.200862 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.200824 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls\") pod \"4bed5560-9ba4-4520-9cf3-98620fe5682d\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " Sep 08 10:48:16.200964 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.200908 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4bed5560-9ba4-4520-9cf3-98620fe5682d-registry-tls\") pod \"4bed5560-9ba4-4520-9cf3-98620fe5682d\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " Sep 08 10:48:16.200964 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.200953 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wczp\" (UniqueName: \"kubernetes.io/projected/4bed5560-9ba4-4520-9cf3-98620fe5682d-kube-api-access-8wczp\") pod \"4bed5560-9ba4-4520-9cf3-98620fe5682d\" (UID: \"4bed5560-9ba4-4520-9cf3-98620fe5682d\") " Sep 08 10:48:16.201386 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.201272 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bed5560-9ba4-4520-9cf3-98620fe5682d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4bed5560-9ba4-4520-9cf3-98620fe5682d" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 10:48:16.201590 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.201559 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bed5560-9ba4-4520-9cf3-98620fe5682d-feast-data" (OuterVolumeSpecName: "feast-data") pod "4bed5560-9ba4-4520-9cf3-98620fe5682d" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:48:16.203067 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.203047 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4bed5560-9ba4-4520-9cf3-98620fe5682d" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.203175 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.203074 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-online-tls" (OuterVolumeSpecName: "online-tls") pod "4bed5560-9ba4-4520-9cf3-98620fe5682d" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.203175 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.203100 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4bed5560-9ba4-4520-9cf3-98620fe5682d" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.203644 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.203628 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bed5560-9ba4-4520-9cf3-98620fe5682d-kube-api-access-8wczp" (OuterVolumeSpecName: "kube-api-access-8wczp") pod "4bed5560-9ba4-4520-9cf3-98620fe5682d" (UID: "4bed5560-9ba4-4520-9cf3-98620fe5682d"). InnerVolumeSpecName "kube-api-access-8wczp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:48:16.240083 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.240062 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:48:16.302257 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302223 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smmh7\" (UniqueName: \"kubernetes.io/projected/25810de6-780f-4685-a846-301f69e32a35-kube-api-access-smmh7\") pod \"25810de6-780f-4685-a846-301f69e32a35\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " Sep 08 10:48:16.302257 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302261 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-ui-tls\") pod \"25810de6-780f-4685-a846-301f69e32a35\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " Sep 08 10:48:16.302490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302301 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25810de6-780f-4685-a846-301f69e32a35-feast-data\") pod \"25810de6-780f-4685-a846-301f69e32a35\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " Sep 08 10:48:16.302490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302320 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-offline-tls\") pod \"25810de6-780f-4685-a846-301f69e32a35\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " Sep 08 10:48:16.302490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302356 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") pod \"25810de6-780f-4685-a846-301f69e32a35\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " Sep 08 10:48:16.302490 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302378 2532 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-online-tls\") pod \"25810de6-780f-4685-a846-301f69e32a35\" (UID: \"25810de6-780f-4685-a846-301f69e32a35\") " Sep 08 10:48:16.302693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302541 2532 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-online-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.302693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302558 2532 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-ui-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.302693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302570 2532 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4bed5560-9ba4-4520-9cf3-98620fe5682d-feast-data\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.302693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302583 2532 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4bed5560-9ba4-4520-9cf3-98620fe5682d-offline-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.302693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302595 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4bed5560-9ba4-4520-9cf3-98620fe5682d-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.302693 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302608 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wczp\" (UniqueName: \"kubernetes.io/projected/4bed5560-9ba4-4520-9cf3-98620fe5682d-kube-api-access-8wczp\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.302985 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.302845 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25810de6-780f-4685-a846-301f69e32a35-feast-data" (OuterVolumeSpecName: "feast-data") pod "25810de6-780f-4685-a846-301f69e32a35" (UID: "25810de6-780f-4685-a846-301f69e32a35"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 10:48:16.304766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.304734 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25810de6-780f-4685-a846-301f69e32a35-kube-api-access-smmh7" (OuterVolumeSpecName: "kube-api-access-smmh7") pod "25810de6-780f-4685-a846-301f69e32a35" (UID: "25810de6-780f-4685-a846-301f69e32a35"). InnerVolumeSpecName "kube-api-access-smmh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 10:48:16.304766 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.304735 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "25810de6-780f-4685-a846-301f69e32a35" (UID: "25810de6-780f-4685-a846-301f69e32a35"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.304913 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.304760 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-online-tls" (OuterVolumeSpecName: "online-tls") pod "25810de6-780f-4685-a846-301f69e32a35" (UID: "25810de6-780f-4685-a846-301f69e32a35"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.305113 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.305090 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25810de6-780f-4685-a846-301f69e32a35" (UID: "25810de6-780f-4685-a846-301f69e32a35"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.305113 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.305106 2532 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "25810de6-780f-4685-a846-301f69e32a35" (UID: "25810de6-780f-4685-a846-301f69e32a35"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 10:48:16.403207 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.403176 2532 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-registry-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.403207 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.403200 2532 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-online-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.403207 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.403209 2532 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smmh7\" (UniqueName: \"kubernetes.io/projected/25810de6-780f-4685-a846-301f69e32a35-kube-api-access-smmh7\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.403207 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.403218 2532 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-ui-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.403445 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.403226 2532 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25810de6-780f-4685-a846-301f69e32a35-feast-data\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.403445 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.403234 2532 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25810de6-780f-4685-a846-301f69e32a35-offline-tls\") on node \"ip-10-0-134-85.ec2.internal\" DevicePath \"\"" Sep 08 10:48:16.524753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524681 2532 generic.go:356] "Generic (PLEG): container finished" podID="25810de6-780f-4685-a846-301f69e32a35" containerID="ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8" exitCode=137 Sep 08 10:48:16.524753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524705 2532 generic.go:356] "Generic (PLEG): container finished" podID="25810de6-780f-4685-a846-301f69e32a35" containerID="48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab" exitCode=137 Sep 08 10:48:16.524753 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524751 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" Sep 08 10:48:16.525405 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524761 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8"} Sep 08 10:48:16.525405 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524808 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab"} Sep 08 10:48:16.525405 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524823 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2" event={"ID":"25810de6-780f-4685-a846-301f69e32a35","Type":"ContainerDied","Data":"dfa2342c180468d898805aae2b9e6f0b93416236f2e6f06f451a18b6f480f406"} Sep 08 10:48:16.525405 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.524844 2532 scope.go:117] "RemoveContainer" containerID="e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842" Sep 08 10:48:16.527744 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.527716 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" event={"ID":"4bed5560-9ba4-4520-9cf3-98620fe5682d","Type":"ContainerDied","Data":"b9e9a243054af427ac76dd2bd64fcabd2d926c06135065e1b0981717d0995cf8"} Sep 08 10:48:16.527843 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.527758 2532 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5" Sep 08 10:48:16.533759 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.533739 2532 scope.go:117] "RemoveContainer" containerID="ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8" Sep 08 10:48:16.541486 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.541470 2532 scope.go:117] "RemoveContainer" containerID="55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033" Sep 08 10:48:16.548754 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.548733 2532 scope.go:117] "RemoveContainer" containerID="48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab" Sep 08 10:48:16.550091 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.550072 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2"] Sep 08 10:48:16.554579 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.554559 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-vcdz2"] Sep 08 10:48:16.557123 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.557107 2532 scope.go:117] "RemoveContainer" containerID="72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84" Sep 08 10:48:16.564120 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.564103 2532 scope.go:117] "RemoveContainer" containerID="ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045" Sep 08 10:48:16.568662 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.568644 2532 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5"] Sep 08 10:48:16.571802 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.571788 2532 scope.go:117] "RemoveContainer" containerID="e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842" Sep 08 10:48:16.572105 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:48:16.572086 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842\": container with ID starting with e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842 not found: ID does not exist" containerID="e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842" Sep 08 10:48:16.572298 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.572115 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842"} err="failed to get container status \"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842\": rpc error: code = NotFound desc = could not find container \"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842\": container with ID starting with e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842 not found: ID does not exist" Sep 08 10:48:16.572298 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.572148 2532 scope.go:117] "RemoveContainer" containerID="ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8" Sep 08 10:48:16.572598 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:48:16.572542 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8\": container with ID starting with ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8 not found: ID does not exist" containerID="ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8" Sep 08 10:48:16.572598 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.572569 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8"} err="failed to get container status \"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8\": rpc error: code = NotFound desc = could not find container \"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8\": container with ID starting with ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8 not found: ID does not exist" Sep 08 10:48:16.572598 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.572589 2532 scope.go:117] "RemoveContainer" containerID="55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033" Sep 08 10:48:16.572988 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:48:16.572963 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033\": container with ID starting with 55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033 not found: ID does not exist" containerID="55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033" Sep 08 10:48:16.573119 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.572994 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033"} err="failed to get container status \"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033\": rpc error: code = NotFound desc = could not find container \"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033\": container with ID starting with 55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033 not found: ID does not exist" Sep 08 10:48:16.573119 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.573016 2532 scope.go:117] "RemoveContainer" containerID="48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab" Sep 08 10:48:16.573346 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:48:16.573321 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab\": container with ID starting with 48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab not found: ID does not exist" containerID="48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab" Sep 08 10:48:16.573393 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.573354 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab"} err="failed to get container status \"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab\": rpc error: code = NotFound desc = could not find container \"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab\": container with ID starting with 48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab not found: ID does not exist" Sep 08 10:48:16.573393 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.573375 2532 scope.go:117] "RemoveContainer" containerID="72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84" Sep 08 10:48:16.573677 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:48:16.573659 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84\": container with ID starting with 72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84 not found: ID does not exist" containerID="72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84" Sep 08 10:48:16.573758 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.573684 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84"} err="failed to get container status \"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84\": rpc error: code = NotFound desc = could not find container \"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84\": container with ID starting with 72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84 not found: ID does not exist" Sep 08 10:48:16.573758 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.573705 2532 scope.go:117] "RemoveContainer" containerID="ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045" Sep 08 10:48:16.574002 ip-10-0-134-85 kubenswrapper[2532]: E0908 10:48:16.573983 2532 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045\": container with ID starting with ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045 not found: ID does not exist" containerID="ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045" Sep 08 10:48:16.574103 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574003 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045"} err="failed to get container status \"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045\": rpc error: code = NotFound desc = could not find container \"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045\": container with ID starting with ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045 not found: ID does not exist" Sep 08 10:48:16.574103 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574016 2532 scope.go:117] "RemoveContainer" containerID="e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842" Sep 08 10:48:16.574103 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574084 2532 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v5vz5"] Sep 08 10:48:16.574308 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574291 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842"} err="failed to get container status \"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842\": rpc error: code = NotFound desc = could not find container \"e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842\": container with ID starting with e528e1f69b63562f4428740dc99b059bd99978592fb28e120d30f0efd1ff8842 not found: ID does not exist" Sep 08 10:48:16.574351 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574309 2532 scope.go:117] "RemoveContainer" containerID="ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8" Sep 08 10:48:16.574517 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574501 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8"} err="failed to get container status \"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8\": rpc error: code = NotFound desc = could not find container \"ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8\": container with ID starting with ed51f9069dab7525fc4cfeaaee6751e11e7acc929df8ea54974c0fc726d603a8 not found: ID does not exist" Sep 08 10:48:16.574563 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574517 2532 scope.go:117] "RemoveContainer" containerID="55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033" Sep 08 10:48:16.574754 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574736 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033"} err="failed to get container status \"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033\": rpc error: code = NotFound desc = could not find container \"55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033\": container with ID starting with 55e1ac3a25039cd37ac81720d913480a41e93e3c16199b2c12c9e86924bfb033 not found: ID does not exist" Sep 08 10:48:16.574825 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574757 2532 scope.go:117] "RemoveContainer" containerID="48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab" Sep 08 10:48:16.574990 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574974 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab"} err="failed to get container status \"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab\": rpc error: code = NotFound desc = could not find container \"48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab\": container with ID starting with 48e70587b15ceddca549a66447d0089236d9f24700208a7199911ad2b8fe59ab not found: ID does not exist" Sep 08 10:48:16.575038 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.574991 2532 scope.go:117] "RemoveContainer" containerID="72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84" Sep 08 10:48:16.575210 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.575191 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84"} err="failed to get container status \"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84\": rpc error: code = NotFound desc = could not find container \"72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84\": container with ID starting with 72e8473cb24c175c8aa01e0e973dabba94239bf934bd68ada1c0ff7b54fa9a84 not found: ID does not exist" Sep 08 10:48:16.575263 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.575210 2532 scope.go:117] "RemoveContainer" containerID="ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045" Sep 08 10:48:16.575418 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.575401 2532 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045"} err="failed to get container status \"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045\": rpc error: code = NotFound desc = could not find container \"ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045\": container with ID starting with ce3b98a6274fe2d2ffc809dda1a76fc53cc62d29bbe042a639002e8bce76b045 not found: ID does not exist" Sep 08 10:48:16.575485 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.575420 2532 scope.go:117] "RemoveContainer" containerID="c759f37c9f1e8debcb62a3e04bd2aed3bc3c01feacae6e6f8c688d583fdae5cf" Sep 08 10:48:16.582210 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.582193 2532 scope.go:117] "RemoveContainer" containerID="f20354ce80200aa964171558c58cf383f5730224f6527365b6592377937cda3e" Sep 08 10:48:16.589427 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.589397 2532 scope.go:117] "RemoveContainer" containerID="b5f08e859b64a57e28777be75244abf17aa4dfb9af45852267e8512316c973a3" Sep 08 10:48:16.596331 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.596314 2532 scope.go:117] "RemoveContainer" containerID="3ba7014067f589a9fd01080017fb5fb06158a50e309c1ed1c6066ab29e3f834b" Sep 08 10:48:16.602976 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.602958 2532 scope.go:117] "RemoveContainer" containerID="be0636d2ef3a663115d0e2bff3e4b446fa92b1c4f6e6b899b313b3a9f67b0db4" Sep 08 10:48:16.658427 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.658388 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25810de6-780f-4685-a846-301f69e32a35" path="/var/lib/kubelet/pods/25810de6-780f-4685-a846-301f69e32a35/volumes" Sep 08 10:48:16.659019 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:16.658999 2532 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" path="/var/lib/kubelet/pods/4bed5560-9ba4-4520-9cf3-98620fe5682d/volumes" Sep 08 10:48:29.246165 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:29.246101 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:29.468123 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:29.468083 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:35.692687 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:35.692606 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:35.782035 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:35.781998 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:35.984769 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:35.984660 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:36.096947 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:36.096916 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:53.704129 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:53.704092 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:53.855888 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:53.855855 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:54.005327 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:54.005236 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:57.335112 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:57.335073 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2b2ct_0fa45e7d-f861-4a82-9355-62781f6cf75b/global-pull-secret-syncer/0.log" Sep 08 10:48:57.522127 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:57.522094 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" Sep 08 10:48:57.712181 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:57.712128 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-85.ec2.internal_49c46abc7be8f37118f6a71adbc1c290/haproxy/0.log" Sep 08 10:48:59.711434 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:59.711395 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:48:59.810763 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:48:59.810728 2532 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ddwr4_1eaa6ddb-ba08-499c-9561-fb63cffc6dc8/konnectivity-agent/0.log" limit=1024 Sep 08 10:49:02.518289 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:02.518256 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s74zf_2f2cda76-1dbe-4da7-90c5-32e0aa1e9945/node-exporter/0.log" Sep 08 10:49:02.548944 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:02.548921 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s74zf_2f2cda76-1dbe-4da7-90c5-32e0aa1e9945/kube-rbac-proxy/0.log" Sep 08 10:49:02.575581 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:02.575561 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s74zf_2f2cda76-1dbe-4da7-90c5-32e0aa1e9945/init-textfile/0.log" Sep 08 10:49:04.838262 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838227 2532 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5"] Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838465 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838477 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838485 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838491 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838501 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838507 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838513 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="feast-apply" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838518 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="feast-apply" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838526 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="feast-init" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838531 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="feast-init" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838536 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="registry" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838541 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="registry" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838549 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="feast-init" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838554 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="feast-init" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838559 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="feast-apply" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838565 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="feast-apply" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838571 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="offline" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838576 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="offline" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838582 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838586 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838593 2532 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="offline" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838597 2532 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="offline" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838638 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="ui" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838645 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="offline" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838651 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="online" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838657 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="ui" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838663 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="registry" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838669 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bed5560-9ba4-4520-9cf3-98620fe5682d" containerName="online" Sep 08 10:49:04.838664 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.838674 2532 memory_manager.go:368] "RemoveStaleState removing state" podUID="25810de6-780f-4685-a846-301f69e32a35" containerName="offline" Sep 08 10:49:04.841504 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.841485 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:04.844043 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.844023 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rvr9p\"/\"kube-root-ca.crt\"" Sep 08 10:49:04.844816 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.844790 2532 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rvr9p\"/\"default-dockercfg-dmg7j\"" Sep 08 10:49:04.844937 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.844831 2532 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rvr9p\"/\"openshift-service-ca.crt\"" Sep 08 10:49:04.854714 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.854689 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5"] Sep 08 10:49:04.952963 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.952925 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-podres\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:04.953205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.952980 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wddg\" (UniqueName: \"kubernetes.io/projected/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-kube-api-access-2wddg\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:04.953205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.953003 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-sys\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:04.953205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.953085 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-proc\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:04.953205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:04.953166 2532 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-lib-modules\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054074 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054036 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-podres\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054097 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wddg\" (UniqueName: \"kubernetes.io/projected/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-kube-api-access-2wddg\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054158 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-sys\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054184 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-proc\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054227 2532 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-lib-modules\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054243 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-podres\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054261 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-sys\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054330 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054319 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-proc\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.054649 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.054372 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-lib-modules\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.071827 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.071779 2532 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wddg\" (UniqueName: \"kubernetes.io/projected/7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32-kube-api-access-2wddg\") pod \"perf-node-gather-daemonset-5kvq5\" (UID: \"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32\") " pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.151277 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.151250 2532 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.428819 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.428722 2532 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5"] Sep 08 10:49:05.432272 ip-10-0-134-85 kubenswrapper[2532]: W0908 10:49:05.432235 2532 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c5109fd_d3bc_4ed7_89ea_88c26dfd4a32.slice/crio-a6789b648c9f6770b04c9800e86aaf7ffe44db176d70ebe9323803f1c29b386a WatchSource:0}: Error finding container a6789b648c9f6770b04c9800e86aaf7ffe44db176d70ebe9323803f1c29b386a: Status 404 returned error can't find the container with id a6789b648c9f6770b04c9800e86aaf7ffe44db176d70ebe9323803f1c29b386a Sep 08 10:49:05.706532 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.706438 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" event={"ID":"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32","Type":"ContainerStarted","Data":"13de9bbc7a3a368099595b83b4256a184ba547e2ba671e0e4b4353de32bc834c"} Sep 08 10:49:05.706532 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.706493 2532 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" event={"ID":"7c5109fd-d3bc-4ed7-89ea-88c26dfd4a32","Type":"ContainerStarted","Data":"a6789b648c9f6770b04c9800e86aaf7ffe44db176d70ebe9323803f1c29b386a"} Sep 08 10:49:05.706725 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.706569 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:05.724856 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:05.724807 2532 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" podStartSLOduration=1.724775543 podStartE2EDuration="1.724775543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:49:05.723446313 +0000 UTC m=+1911.610155827" watchObservedRunningTime="2026-09-08 10:49:05.724775543 +0000 UTC m=+1911.611485036" Sep 08 10:49:06.906205 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:06.906175 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qwnl9_e09965ad-afe0-48da-98ee-e47d127c704e/dns/0.log" Sep 08 10:49:06.928872 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:06.928845 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qwnl9_e09965ad-afe0-48da-98ee-e47d127c704e/kube-rbac-proxy/0.log" Sep 08 10:49:06.954571 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:06.954546 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7krmk_ad1d3048-607f-44b9-8939-1278844d4b7a/dns-node-resolver/0.log" Sep 08 10:49:07.540450 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:07.540422 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x5vlj_42116614-b54c-4c7a-b55b-76b573209685/node-ca/0.log" Sep 08 10:49:08.814540 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:08.814504 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jcwz5_b931dbcf-c9bd-4252-a1f0-c7639936ca5f/serve-healthcheck-canary/0.log" Sep 08 10:49:09.237568 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:09.237539 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-m8r6n_eb0e5afe-33be-434d-8625-9d93104d489e/insights-operator/0.log" Sep 08 10:49:09.237743 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:09.237672 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-m8r6n_eb0e5afe-33be-434d-8625-9d93104d489e/insights-operator/1.log" Sep 08 10:49:09.452970 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:09.452940 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjwk5_3699ff39-87cb-4703-a118-b18579397bc6/kube-rbac-proxy/0.log" Sep 08 10:49:09.478317 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:09.478290 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjwk5_3699ff39-87cb-4703-a118-b18579397bc6/exporter/0.log" Sep 08 10:49:09.507670 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:09.507594 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjwk5_3699ff39-87cb-4703-a118-b18579397bc6/extractor/0.log" Sep 08 10:49:11.720088 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:11.720065 2532 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rvr9p/perf-node-gather-daemonset-5kvq5" Sep 08 10:49:14.966388 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:14.966362 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-bdbcs_f1b46302-b131-4810-a2ae-1eb802925e24/migrator/0.log" Sep 08 10:49:14.988944 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:14.988923 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-bdbcs_f1b46302-b131-4810-a2ae-1eb802925e24/graceful-termination/0.log" Sep 08 10:49:16.628387 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.628306 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/kube-multus-additional-cni-plugins/0.log" Sep 08 10:49:16.650966 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.650939 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/egress-router-binary-copy/0.log" Sep 08 10:49:16.672818 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.672793 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/cni-plugins/0.log" Sep 08 10:49:16.694340 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.694312 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/bond-cni-plugin/0.log" Sep 08 10:49:16.716599 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.716559 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/routeoverride-cni/0.log" Sep 08 10:49:16.740885 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.740859 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/whereabouts-cni-bincopy/0.log" Sep 08 10:49:16.763553 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.763523 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vw7fl_876c61ed-2c19-45d1-b8bd-7f003c76ecbe/whereabouts-cni/0.log" Sep 08 10:49:16.980858 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:16.980829 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hl4wb_9de127b1-2c05-4b2f-8645-e5aa4352da22/kube-multus/0.log" Sep 08 10:49:17.185418 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:17.185388 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rlbmt_7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec/network-metrics-daemon/0.log" Sep 08 10:49:17.227324 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:17.227300 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rlbmt_7900bcde-f292-4ce6-a9cf-c9f0ce2e2bec/kube-rbac-proxy/0.log" Sep 08 10:49:18.280878 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.280850 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/ovn-controller/0.log" Sep 08 10:49:18.314459 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.310225 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/ovn-acl-logging/0.log" Sep 08 10:49:18.337332 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.337304 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/kube-rbac-proxy-node/0.log" Sep 08 10:49:18.364797 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.364766 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 10:49:18.393772 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.393729 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/northd/0.log" Sep 08 10:49:18.420005 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.419982 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/nbdb/0.log" Sep 08 10:49:18.442362 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.442338 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/sbdb/0.log" Sep 08 10:49:18.479901 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:18.479876 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qhqt2_c6a9cfea-072a-4702-8736-7157612f501a/ovnkube-controller/0.log" Sep 08 10:49:19.717002 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:19.716968 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-hb4kc_aed072c9-cb84-4344-861f-461f449e1fe1/check-endpoints/0.log" Sep 08 10:49:19.769989 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:19.769966 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-b86ls_5d373d64-68cb-4acf-aaa2-b32ab5cdf64c/network-check-target-container/0.log" Sep 08 10:49:20.816199 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:20.816080 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tq5h9_9394da66-c253-462e-a139-3ea6c54b6f20/iptables-alerter/0.log" Sep 08 10:49:21.610997 ip-10-0-134-85 kubenswrapper[2532]: I0908 10:49:21.610971 2532 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tjhwb_933214fb-4f09-4163-a330-8a1512012a8f/tuned/0.log"