Jun 11 09:34:32.633064 ip-10-0-137-96 systemd[1]: Starting Kubernetes Kubelet... Jun 11 09:34:33.017461 ip-10-0-137-96 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 09:34:33.017461 ip-10-0-137-96 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 09:34:33.017461 ip-10-0-137-96 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 09:34:33.017461 ip-10-0-137-96 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 09:34:33.017461 ip-10-0-137-96 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 09:34:33.018612 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.018527 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 09:34:33.024002 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.023986 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 09:34:33.024002 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024002 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024006 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024009 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024013 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024016 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024019 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024022 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024025 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024027 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024030 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024033 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024036 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024038 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024041 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024044 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024047 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024049 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024052 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024055 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024060 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 09:34:33.024084 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024067 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024070 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024073 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024076 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024078 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024081 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024084 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024086 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024089 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024094 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024098 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024101 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024105 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024108 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024112 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024115 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024118 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024121 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024123 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 09:34:33.024648 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024126 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024128 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024131 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024133 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024136 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024139 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024141 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024143 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024146 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024149 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024151 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024154 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024156 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024160 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024163 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024166 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024169 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024171 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024174 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024177 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 09:34:33.025140 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024179 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024182 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024184 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024187 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024190 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024193 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024195 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024198 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024201 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024203 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024206 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024209 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024212 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024214 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024217 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024221 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024224 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024227 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024230 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 09:34:33.025624 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024232 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024235 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024237 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024240 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024243 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024246 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024248 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024251 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024255 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024258 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024261 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024263 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024266 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024269 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024272 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024274 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024277 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024279 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024282 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.024284 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 09:34:33.026125 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025003 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025011 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025016 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025019 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025022 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025025 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025028 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025030 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025033 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025036 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025038 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025041 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025058 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025061 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025064 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025066 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025069 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025072 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025074 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 09:34:33.026604 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025077 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025080 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025084 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025086 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025089 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025092 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025095 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025097 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025100 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025104 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025109 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025112 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025115 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025118 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025121 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025123 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025126 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025129 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025132 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025134 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 09:34:33.027091 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025137 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025140 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025142 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025145 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025148 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025152 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025155 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025159 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025161 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025164 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025167 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025170 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025173 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025177 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025180 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025183 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025185 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025188 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025190 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 09:34:33.027580 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025193 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025195 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025198 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025200 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025203 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025205 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025208 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025211 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025213 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025216 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025219 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025222 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025224 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025227 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025231 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025233 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025236 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025239 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025241 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025244 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 09:34:33.028087 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025246 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025249 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025251 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025254 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025256 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025259 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025263 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025265 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025268 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025271 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025273 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025276 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025278 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025281 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025284 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025286 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025289 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025291 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025293 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 09:34:33.028574 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025296 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025299 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025704 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025712 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025716 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025719 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025723 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025726 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025728 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025731 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025733 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025736 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025739 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025742 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025744 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025747 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025750 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025752 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025767 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 09:34:33.029070 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025771 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025774 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025776 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025779 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025782 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025785 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025788 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025790 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025793 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025796 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025798 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025801 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025804 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025807 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025809 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025812 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025816 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025819 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025822 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025824 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 09:34:33.029520 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025827 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025830 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025833 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025835 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025838 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025841 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025844 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025848 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025851 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025855 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025858 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025861 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025864 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025867 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025870 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025873 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025876 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025879 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025881 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 09:34:33.030015 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025885 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025888 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025891 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025894 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025896 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025900 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025902 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025905 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025908 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025916 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025919 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025921 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025924 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025926 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025929 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025932 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025934 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025937 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025939 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 09:34:33.030478 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025943 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025946 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025949 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025951 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025954 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025956 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025959 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025961 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025964 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025967 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025969 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025972 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025975 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025977 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025980 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025982 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025985 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025987 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025994 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025996 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 09:34:33.030983 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.025999 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026001 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026005 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026008 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026069 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026076 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026082 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026086 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026090 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026094 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026098 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026102 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026105 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026108 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026112 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026116 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026118 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026121 2557 flags.go:64] FLAG: --cgroup-root="" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026124 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026127 2557 flags.go:64] FLAG: --client-ca-file="" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026131 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026134 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026138 2557 flags.go:64] FLAG: --cluster-domain="" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026141 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 09:34:33.031464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026145 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026148 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026151 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026154 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026157 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026160 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026165 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026168 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026171 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026174 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026178 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026182 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026186 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026189 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026191 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026194 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026197 2557 flags.go:64] FLAG: --enable-server="true" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026200 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026205 2557 flags.go:64] FLAG: --event-burst="100" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026208 2557 flags.go:64] FLAG: --event-qps="50" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026211 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026214 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026217 2557 flags.go:64] FLAG: --eviction-hard="" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026221 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 09:34:33.032056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026224 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026226 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026229 2557 flags.go:64] FLAG: --eviction-soft="" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026232 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026235 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026238 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026241 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026244 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026247 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026250 2557 flags.go:64] FLAG: --feature-gates="" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026254 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026257 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026260 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026263 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026267 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026270 2557 flags.go:64] FLAG: --help="false" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026273 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026276 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026280 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026283 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026286 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026290 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026293 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 09:34:33.032635 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026296 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026298 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026301 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026306 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026311 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026316 2557 flags.go:64] FLAG: --kube-reserved="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026319 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026322 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026325 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026328 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026331 2557 flags.go:64] FLAG: --lock-file="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026333 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026336 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026340 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026345 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026348 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026351 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026354 2557 flags.go:64] FLAG: --logging-format="text" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026356 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026361 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026363 2557 flags.go:64] FLAG: --manifest-url="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026366 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026370 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026375 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026379 2557 flags.go:64] FLAG: --max-pods="110" Jun 11 09:34:33.033468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026381 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026385 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026389 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026392 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026395 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026398 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026401 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026408 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026411 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026414 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026417 2557 flags.go:64] FLAG: --pod-cidr="" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026420 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026426 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026429 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026432 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026435 2557 flags.go:64] FLAG: --port="10250" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026438 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026441 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056a287249069aad2" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026444 2557 flags.go:64] FLAG: --qos-reserved="" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026447 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026450 2557 flags.go:64] FLAG: --register-node="true" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026453 2557 flags.go:64] FLAG: --register-with-taints="" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026456 2557 flags.go:64] FLAG: --registry-burst="10" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026459 2557 flags.go:64] FLAG: --registry-qps="5" Jun 11 09:34:33.034539 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026462 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026465 2557 flags.go:64] FLAG: --reserved-memory="" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026468 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026472 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026475 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026477 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026480 2557 flags.go:64] FLAG: --runonce="false" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026484 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026487 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026490 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026495 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026498 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026500 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026504 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026507 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026509 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026512 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026515 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026518 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026521 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026524 2557 flags.go:64] FLAG: --system-cgroups="" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026527 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026532 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026535 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026538 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 09:34:33.035265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026542 2557 flags.go:64] FLAG: --tls-min-version="" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026544 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026547 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026550 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026553 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026556 2557 flags.go:64] FLAG: --v="2" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026560 2557 flags.go:64] FLAG: --version="false" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026563 2557 flags.go:64] FLAG: --vmodule="" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026567 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.026571 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026681 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026686 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026691 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026695 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026699 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026702 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026705 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026708 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026711 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026714 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026717 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 09:34:33.035902 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026719 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026722 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026725 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026727 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026730 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026732 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026735 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026738 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026741 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026743 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026746 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026748 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026751 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026754 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026771 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026774 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026777 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026780 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026782 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026785 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 09:34:33.036406 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026788 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026791 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026793 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026800 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026803 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026806 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026808 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026811 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026814 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026817 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026820 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026823 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026826 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026828 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026831 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026833 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026836 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026839 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026841 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026844 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 09:34:33.037000 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026847 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026849 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026852 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026854 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026857 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026860 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026862 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026865 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026867 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026870 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026872 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026875 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026878 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026880 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026883 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026886 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026889 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026891 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026894 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026896 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 09:34:33.037487 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026899 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026902 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026904 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026907 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026909 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026911 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026914 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026917 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026919 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026922 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026924 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026929 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026932 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026935 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026938 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026940 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026943 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026946 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026948 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026951 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 09:34:33.037984 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026953 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026955 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026958 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026960 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026963 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026966 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026968 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.026971 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.027870 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.035868 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.035884 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.035903 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.035912 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035968 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 09:34:33.038469 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035973 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035977 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035980 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035984 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035987 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035990 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035993 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035996 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.035998 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036001 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036004 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036007 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036010 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036012 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036015 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036017 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036021 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036023 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036026 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036029 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 09:34:33.038857 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036032 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036034 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036037 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036040 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036042 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036046 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036049 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036052 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036056 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036058 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036061 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036064 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036066 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036069 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036072 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036076 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036080 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036083 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036086 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036090 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 09:34:33.039350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036093 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036095 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036098 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036101 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036103 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036112 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036115 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036118 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036120 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036123 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036126 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036128 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036131 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036133 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036136 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036139 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036142 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036144 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036147 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036150 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 09:34:33.039847 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036154 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036156 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036160 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036162 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036165 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036167 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036170 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036173 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036176 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036178 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036181 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036183 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036186 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036189 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036191 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036194 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036196 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036198 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036207 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 09:34:33.040371 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036209 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036213 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036217 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036220 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036223 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036227 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036230 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036233 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036235 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036238 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036241 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036244 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036246 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036250 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036252 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036255 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036258 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036260 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 09:34:33.040942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036263 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.036268 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036390 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036395 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036399 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036402 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036404 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036408 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036411 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036414 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036417 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036419 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036422 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036425 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036434 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 09:34:33.041373 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036437 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036439 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036442 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036445 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036448 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036451 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036454 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036456 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036459 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036463 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036466 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036469 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036472 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036475 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036478 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036481 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036483 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036486 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036488 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 09:34:33.041834 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036491 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036495 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036499 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036503 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036506 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036509 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036512 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036515 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036517 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036520 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036528 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036531 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036533 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036537 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036540 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036543 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036545 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036548 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036550 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 09:34:33.042286 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036553 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036556 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036558 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036561 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036563 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036566 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036569 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036572 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036574 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036577 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036579 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036582 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036585 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036587 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036590 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036592 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036595 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036597 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036608 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036611 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 11 09:34:33.043397 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036614 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036616 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036619 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036622 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036624 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036627 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036630 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036633 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036636 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036639 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036641 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036644 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036646 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036649 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036652 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036654 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036657 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036659 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036662 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036665 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 09:34:33.043912 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036668 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036671 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036673 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036676 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036678 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036681 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036683 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:33.036686 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.036690 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.036814 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.039252 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.041655 2557 server.go:1019] "Starting client certificate rotation" Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.041769 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 09:34:33.044385 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.041837 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 09:34:33.044717 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.044092 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 09:34:33.045248 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.045228 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 09:34:33.059362 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.059341 2557 log.go:25] "Validated CRI v1 runtime API" Jun 11 09:34:33.062206 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.062188 2557 log.go:25] "Validated CRI v1 image API" Jun 11 09:34:33.063031 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.063018 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 09:34:33.066024 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.066004 2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c6da15b8-be06-4b84-9045-104ca92d2151:/dev/nvme0n1p3 d4cd6ada-5a6e-4f89-a1e6-d08460a5cbb4:/dev/nvme0n1p4] Jun 11 09:34:33.066097 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.066023 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 09:34:33.070567 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.070382 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 09:34:33.071798 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.071670 2557 manager.go:216] Machine: {Timestamp:2026-06-11 09:34:33.069975203 +0000 UTC m=+0.320672772 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109797 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28dd81eb721f174a71827894bc821a SystemUUID:ec28dd81-eb72-1f17-4a71-827894bc821a BootID:5ff9ed59-ab21-4fe2-9a72-0cd376f8fa11 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:aa:93:36:51 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:aa:93:36:51 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:5f:0d:a9:f4:b0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 09:34:33.071798 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.071792 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 09:34:33.071932 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.071878 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 09:34:33.074864 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.074842 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 09:34:33.074996 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.074867 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 09:34:33.076112 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.076101 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 09:34:33.076151 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.076114 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 09:34:33.076151 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.076122 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 09:34:33.076786 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.076775 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 09:34:33.077585 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.077576 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 09:34:33.080462 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080451 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 11 09:34:33.080747 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080737 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 09:34:33.080802 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080784 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 11 09:34:33.080802 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080794 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 09:34:33.080870 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080808 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 09:34:33.080870 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080817 2557 kubelet.go:398] "Adding apiserver pod source" Jun 11 09:34:33.080870 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.080827 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 09:34:33.081167 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.081156 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 09:34:33.081202 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.081175 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 09:34:33.083936 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.083920 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 09:34:33.085945 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.085930 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 09:34:33.086009 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.085960 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 09:34:33.087399 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087385 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 09:34:33.087461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087408 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 09:34:33.087461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087418 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 09:34:33.087461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087427 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 09:34:33.087461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087441 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 09:34:33.087461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087447 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 09:34:33.087685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087468 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 09:34:33.087685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087475 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 09:34:33.087685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087481 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 09:34:33.087685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087486 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 09:34:33.087685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087502 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 09:34:33.087685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.087508 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 09:34:33.088978 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.088965 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 09:34:33.088978 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.088977 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 09:34:33.090019 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.089996 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 09:34:33.090094 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.089999 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 09:34:33.092163 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.092136 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 09:34:33.092354 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.092342 2557 server.go:1268] "Started kubelet" Jun 11 09:34:33.092453 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.092429 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 09:34:33.092503 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.092425 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 09:34:33.092503 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.092495 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 09:34:33.093326 ip-10-0-137-96 systemd[1]: Started Kubernetes Kubelet. Jun 11 09:34:33.093565 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.093508 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 11 09:34:33.094260 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.094195 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 09:34:33.098949 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.098919 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 09:34:33.099361 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.099347 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 09:34:33.099431 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.099347 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 09:34:33.099888 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.099507 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.100004 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.099986 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 09:34:33.100004 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.099986 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 09:34:33.100160 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100012 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 09:34:33.100160 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100097 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 11 09:34:33.100160 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100106 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 11 09:34:33.100608 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100585 2557 factory.go:55] Registering systemd factory Jun 11 09:34:33.100608 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100609 2557 factory.go:223] Registration of the systemd container factory successfully Jun 11 09:34:33.100841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100829 2557 factory.go:153] Registering CRI-O factory Jun 11 09:34:33.100841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100842 2557 factory.go:223] Registration of the crio container factory successfully Jun 11 09:34:33.100947 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100897 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 09:34:33.100947 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100927 2557 factory.go:103] Registering Raw factory Jun 11 09:34:33.101041 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.100950 2557 manager.go:1196] Started watching for new ooms in manager Jun 11 09:34:33.101041 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.101016 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 09:34:33.101130 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.101037 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 09:34:33.101331 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.101313 2557 manager.go:349] Starting recovery of all containers Jun 11 09:34:33.102152 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.101099 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-96.ec2.internal.18b7fd1bb514f16b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-96.ec2.internal,UID:ip-10-0-137-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-96.ec2.internal,},FirstTimestamp:2026-06-11 09:34:33.092313451 +0000 UTC m=+0.343011020,LastTimestamp:2026-06-11 09:34:33.092313451 +0000 UTC m=+0.343011020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-96.ec2.internal,}" Jun 11 09:34:33.107901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.107711 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vwrw4" Jun 11 09:34:33.111520 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.111505 2557 manager.go:354] Recovery completed Jun 11 09:34:33.115502 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.115483 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vwrw4" Jun 11 09:34:33.116847 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.116836 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.118634 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.118618 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.118703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.118650 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.118703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.118661 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.119163 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119149 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 09:34:33.119163 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119162 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 09:34:33.119262 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119178 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 11 09:34:33.119262 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119204 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.119930 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119914 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.119974 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119938 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.119974 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.119952 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.120525 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.120513 2557 policy_none.go:49] "None policy: Start" Jun 11 09:34:33.120568 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.120530 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 09:34:33.120568 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.120540 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 09:34:33.121222 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.121136 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-96.ec2.internal.18b7fd1bb6a68be9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-96.ec2.internal,UID:ip-10-0-137-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-96.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-96.ec2.internal,},FirstTimestamp:2026-06-11 09:34:33.118632937 +0000 UTC m=+0.369330510,LastTimestamp:2026-06-11 09:34:33.118632937 +0000 UTC m=+0.369330510,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-96.ec2.internal,}" Jun 11 09:34:33.121443 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.121428 2557 policy_none.go:47] "Start" Jun 11 09:34:33.157466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157434 2557 manager.go:337] "Starting Device Plugin manager" Jun 11 09:34:33.157466 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.157474 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157486 2557 server.go:87] "Starting device plugin registration server" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157727 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157738 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157807 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157906 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.157915 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.158491 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.158531 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.169024 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.170091 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.170141 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.170165 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.170205 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 09:34:33.172204 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.172119 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 09:34:33.258163 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.258128 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.259274 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.259253 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.259390 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.259289 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.259390 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.259303 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.259390 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.259330 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.269079 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.269029 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.269079 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.269056 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-96.ec2.internal\": node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.271243 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.271226 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal"] Jun 11 09:34:33.271289 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.271284 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.272545 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.272532 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.272620 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.272556 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.272620 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.272567 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.273740 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.273729 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.273901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.273886 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.273959 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.273924 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.274562 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.274541 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.274659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.274565 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.274659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.274579 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.274659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.274546 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.274659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.274636 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.274659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.274647 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.275832 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.275814 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.275906 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.275846 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 09:34:33.276475 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.276462 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientMemory" Jun 11 09:34:33.276543 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.276485 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 09:34:33.276543 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.276495 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeHasSufficientPID" Jun 11 09:34:33.290967 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.290945 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.300341 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.300325 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.301199 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.301182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a4d0037bc836100039b5ba89f25455a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"3a4d0037bc836100039b5ba89f25455a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.301270 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.301213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e3975a94ce874e15a33ae15093f7df3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"7e3975a94ce874e15a33ae15093f7df3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.301270 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.301241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a4d0037bc836100039b5ba89f25455a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"3a4d0037bc836100039b5ba89f25455a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.304709 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.304693 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-96.ec2.internal\" not found" node="ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.391539 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.391515 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.402050 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.402029 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a4d0037bc836100039b5ba89f25455a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"3a4d0037bc836100039b5ba89f25455a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.402156 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.402057 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a4d0037bc836100039b5ba89f25455a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"3a4d0037bc836100039b5ba89f25455a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.402156 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.402073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e3975a94ce874e15a33ae15093f7df3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"7e3975a94ce874e15a33ae15093f7df3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.402156 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.402115 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a4d0037bc836100039b5ba89f25455a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"3a4d0037bc836100039b5ba89f25455a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.402156 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.402132 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e3975a94ce874e15a33ae15093f7df3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-96.ec2.internal\" (UID: \"7e3975a94ce874e15a33ae15093f7df3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.402279 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.402115 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a4d0037bc836100039b5ba89f25455a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal\" (UID: \"3a4d0037bc836100039b5ba89f25455a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.492531 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.492483 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.593344 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.593319 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.604721 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.604699 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.609355 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.609338 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Jun 11 09:34:33.693985 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.693951 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.794469 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.794434 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.895012 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:33.894926 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-96.ec2.internal\" not found" Jun 11 09:34:33.957800 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.957753 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 09:34:33.999825 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:33.999795 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" Jun 11 09:34:34.020142 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.020117 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 09:34:34.022025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.022006 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:34.039928 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.039913 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 09:34:34.040041 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.040011 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 09:34:34.040088 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.040028 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 09:34:34.040088 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.040051 2557 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.137.96:47704->3.215.136.109:6443: use of closed network connection" Jun 11 09:34:34.040152 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.040096 2557 kubelet.go:3250] "Failed creating a mirror pod" err="unexpected error when reading response body. Please retry. Original error: read tcp 10.0.137.96:47704->3.215.136.109:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" Jun 11 09:34:34.081274 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.081225 2557 apiserver.go:52] "Watching apiserver" Jun 11 09:34:34.098518 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.098493 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 09:34:34.099666 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.099643 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-rjddd","kube-system/konnectivity-agent-47hlh","openshift-dns/node-resolver-c2dfw","openshift-image-registry/node-ca-5dhcg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal","openshift-network-diagnostics/network-check-target-fzf96","openshift-ovn-kubernetes/ovnkube-node-jcpx7","kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t","openshift-cluster-node-tuning-operator/tuned-tz9wb","openshift-multus/multus-additional-cni-plugins-h44sc","openshift-multus/multus-mr5s7","openshift-multus/network-metrics-daemon-lcnlh","openshift-network-operator/iptables-alerter-ksjxk"] Jun 11 09:34:34.099666 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.099662 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 09:34:34.101931 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.101912 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.103958 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.103929 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.104106 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.104085 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 09:34:34.105701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.105681 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.105805 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.105746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 09:34:34.105805 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.105779 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j5vp6\"" Jun 11 09:34:34.105921 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.105821 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 09:34:34.105921 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.105856 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.105921 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.105894 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 09:34:34.106058 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106045 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 09:34:34.106110 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-run-netns\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106156 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106119 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-node-log\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106156 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-log-socket\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106159 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-cni-bin\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nspgh\" (UniqueName: \"kubernetes.io/projected/4d57e6e7-b860-418b-bd61-b36fb2dacedb-kube-api-access-nspgh\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106285 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106247 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106285 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106270 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106355 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106286 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovnkube-config\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106355 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106318 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovn-node-metrics-cert\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106355 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-systemd-units\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106355 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-var-lib-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-etc-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-ovn\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106414 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovnkube-script-lib\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-kubelet\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-slash\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106862 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106513 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.106862 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106549 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-systemd\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106862 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-cni-netd\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.106862 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.106592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-env-overrides\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.107511 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.107496 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 09:34:34.107560 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.107518 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 09:34:34.108048 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.108032 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.108213 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.108200 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.108327 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.108312 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-699f2\"" Jun 11 09:34:34.109830 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.109815 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.110364 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.110346 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.110364 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.110351 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.110662 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.110649 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mqln4\"" Jun 11 09:34:34.112280 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.112259 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 09:34:34.112280 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.112274 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8h888\"" Jun 11 09:34:34.112484 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.112266 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.112484 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.112263 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.112484 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.112396 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.114660 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.114640 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:34.114774 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.114704 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:34.116252 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.116241 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 09:34:34.116329 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.116312 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.116379 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.116351 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4wd48\"" Jun 11 09:34:34.116809 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.116793 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.117024 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.117010 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.117815 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.117792 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 09:29:33 +0000 UTC" deadline="2028-02-05 21:28:11.257019566 +0000 UTC" Jun 11 09:34:34.117883 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.117816 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14507h53m37.139207579s" Jun 11 09:34:34.119417 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.119401 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 09:34:34.119603 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.119589 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.119663 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.119652 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.119706 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.119692 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2lltp\"" Jun 11 09:34:34.119935 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.119922 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.119986 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.119971 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:34.122826 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.122811 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.124961 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.124945 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.125529 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.125506 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 09:34:34.125677 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.125662 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-25lzh\"" Jun 11 09:34:34.125788 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.125753 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 09:34:34.127731 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.127697 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.128053 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.128032 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:34.129377 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.129356 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kt48r\"" Jun 11 09:34:34.129450 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.129383 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 09:34:34.129716 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.129702 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 09:34:34.130351 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.130333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.133340 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.133327 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 09:34:34.133568 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.133554 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mpwxh\"" Jun 11 09:34:34.151804 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.151787 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 09:34:34.175279 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.175249 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3975a94ce874e15a33ae15093f7df3.slice/crio-2710ad6f4918e7a04161feefcf967eaeaabb9602171151ba4864d5cbb46c7942 WatchSource:0}: Error finding container 2710ad6f4918e7a04161feefcf967eaeaabb9602171151ba4864d5cbb46c7942: Status 404 returned error can't find the container with id 2710ad6f4918e7a04161feefcf967eaeaabb9602171151ba4864d5cbb46c7942 Jun 11 09:34:34.175530 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.175509 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4d0037bc836100039b5ba89f25455a.slice/crio-4e555aa70bb42485a5941894ca7d73beb9fa9f239c087791729543ca4dd77609 WatchSource:0}: Error finding container 4e555aa70bb42485a5941894ca7d73beb9fa9f239c087791729543ca4dd77609: Status 404 returned error can't find the container with id 4e555aa70bb42485a5941894ca7d73beb9fa9f239c087791729543ca4dd77609 Jun 11 09:34:34.179634 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.179469 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 09:34:34.200931 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.200915 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 09:34:34.207564 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207541 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cni-binary-copy\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.207652 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207572 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-system-cni-dir\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.207652 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207587 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-registration-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.207652 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207602 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207649 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-sys\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207714 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f20681de-fd57-4b00-93b0-1f58c1dc6868-cni-binary-copy\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-run\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-systemd-units\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207804 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-var-lib-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.207841 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207827 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-os-release\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207851 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdqmq\" (UniqueName: \"kubernetes.io/projected/c65cf062-90d4-41de-a2e1-6be061576475-kube-api-access-zdqmq\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207863 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-systemd-units\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-tmp\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207865 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-var-lib-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-cni-bin\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/f20681de-fd57-4b00-93b0-1f58c1dc6868-kube-api-access-nhqcc\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65cf062-90d4-41de-a2e1-6be061576475-tmp-dir\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207968 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-run-netns\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.207995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-log-socket\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208020 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-run-netns\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208027 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d87c275-3b60-46a1-ae16-8b8a83a371bc-serviceca\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-log-socket\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208091 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysctl-d\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.208119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208130 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-tuned\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-os-release\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-etc-kubernetes\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208191 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-ovn\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovnkube-script-lib\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208217 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-ovn\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208240 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-k8s-cni-cncf-io\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208267 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-kubelet\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-slash\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208300 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-env-overrides\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c65cf062-90d4-41de-a2e1-6be061576475-hosts-file\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208340 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-slash\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208353 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-kubelet\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208377 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-device-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.208720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208392 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq7lr\" (UniqueName: \"kubernetes.io/projected/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-kube-api-access-jq7lr\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysctl-conf\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208427 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysconfig\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208445 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208459 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovnkube-config\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208502 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208509 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-sys-fs\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208551 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wkzv\" (UniqueName: \"kubernetes.io/projected/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-kube-api-access-5wkzv\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-run-ovn-kubernetes\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208583 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-var-lib-kubelet\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208730 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-env-overrides\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208792 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovnkube-script-lib\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209022 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-host\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209045 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:34.209310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209062 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c137833-44bc-44d4-af02-8abe248d768b-konnectivity-ca\") pod \"konnectivity-agent-47hlh\" (UID: \"3c137833-44bc-44d4-af02-8abe248d768b\") " pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209099 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-systemd\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-cnibin\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209185 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-run-systemd\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209229 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-netns\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-hostroot\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-cni-bin\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.208919 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovnkube-config\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209612 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-cni-bin\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209633 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d87c275-3b60-46a1-ae16-8b8a83a371bc-host\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209689 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28ae5677-a4b3-45d0-ad63-57ce72ec178e-host-slash\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209751 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209940 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-socket-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.209972 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n9m5\" (UniqueName: \"kubernetes.io/projected/b4f19fec-d824-439a-9722-e2af866a4010-kube-api-access-5n9m5\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.210025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210006 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47ca36d9-6678-40e0-bdb9-82b77f074535-kubelet-config\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210040 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovn-node-metrics-cert\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cnibin\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210095 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9s25\" (UniqueName: \"kubernetes.io/projected/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-kube-api-access-b9s25\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210126 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccdgn\" (UniqueName: \"kubernetes.io/projected/8d87c275-3b60-46a1-ae16-8b8a83a371bc-kube-api-access-ccdgn\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-system-cni-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210187 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-cni-multus\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210217 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-kubelet\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-conf-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-etc-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210303 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctj69\" (UniqueName: \"kubernetes.io/projected/28ae5677-a4b3-45d0-ad63-57ce72ec178e-kube-api-access-ctj69\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-kubernetes\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c137833-44bc-44d4-af02-8abe248d768b-agent-certs\") pod \"konnectivity-agent-47hlh\" (UID: \"3c137833-44bc-44d4-af02-8abe248d768b\") " pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47ca36d9-6678-40e0-bdb9-82b77f074535-dbus\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210414 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-daemon-config\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-cni-netd\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.210651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210477 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-etc-selinux\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210506 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-modprobe-d\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210549 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-systemd\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210577 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-socket-dir-parent\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-multus-certs\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210637 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-node-log\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210670 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nspgh\" (UniqueName: \"kubernetes.io/projected/4d57e6e7-b860-418b-bd61-b36fb2dacedb-kube-api-access-nspgh\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210696 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28ae5677-a4b3-45d0-ad63-57ce72ec178e-iptables-alerter-script\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-lib-modules\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.210753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-cni-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.211326 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.211187 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 09:34:34.212378 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.212359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-host-cni-netd\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.212479 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.212390 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-etc-openvswitch\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.212479 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.212430 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4d57e6e7-b860-418b-bd61-b36fb2dacedb-node-log\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.214546 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.214528 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d57e6e7-b860-418b-bd61-b36fb2dacedb-ovn-node-metrics-cert\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.255034 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.255012 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nspgh\" (UniqueName: \"kubernetes.io/projected/4d57e6e7-b860-418b-bd61-b36fb2dacedb-kube-api-access-nspgh\") pod \"ovnkube-node-jcpx7\" (UID: \"4d57e6e7-b860-418b-bd61-b36fb2dacedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.311149 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311106 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-k8s-cni-cncf-io\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.311149 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311153 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c65cf062-90d4-41de-a2e1-6be061576475-hosts-file\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311210 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-k8s-cni-cncf-io\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c65cf062-90d4-41de-a2e1-6be061576475-hosts-file\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311262 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-device-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq7lr\" (UniqueName: \"kubernetes.io/projected/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-kube-api-access-jq7lr\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysctl-conf\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311324 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311312 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysconfig\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311328 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-sys-fs\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wkzv\" (UniqueName: \"kubernetes.io/projected/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-kube-api-access-5wkzv\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311393 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-var-lib-kubelet\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysconfig\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311413 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-host\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311431 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-sys-fs\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311451 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysctl-conf\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311466 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c137833-44bc-44d4-af02-8abe248d768b-konnectivity-ca\") pod \"konnectivity-agent-47hlh\" (UID: \"3c137833-44bc-44d4-af02-8abe248d768b\") " pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311503 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-var-lib-kubelet\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-device-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-host\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311370 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-cnibin\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-netns\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.311647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-hostroot\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311603 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-netns\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-cnibin\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-hostroot\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d87c275-3b60-46a1-ae16-8b8a83a371bc-host\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28ae5677-a4b3-45d0-ad63-57ce72ec178e-host-slash\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311722 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d87c275-3b60-46a1-ae16-8b8a83a371bc-host\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28ae5677-a4b3-45d0-ad63-57ce72ec178e-host-slash\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311755 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311818 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-socket-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n9m5\" (UniqueName: \"kubernetes.io/projected/b4f19fec-d824-439a-9722-e2af866a4010-kube-api-access-5n9m5\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311877 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47ca36d9-6678-40e0-bdb9-82b77f074535-kubelet-config\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311903 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cnibin\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311931 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9s25\" (UniqueName: \"kubernetes.io/projected/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-kube-api-access-b9s25\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311941 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-socket-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.312188 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311941 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccdgn\" (UniqueName: \"kubernetes.io/projected/8d87c275-3b60-46a1-ae16-8b8a83a371bc-kube-api-access-ccdgn\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311980 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47ca36d9-6678-40e0-bdb9-82b77f074535-kubelet-config\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.311987 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-system-cni-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312025 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cnibin\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312031 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-system-cni-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312057 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c137833-44bc-44d4-af02-8abe248d768b-konnectivity-ca\") pod \"konnectivity-agent-47hlh\" (UID: \"3c137833-44bc-44d4-af02-8abe248d768b\") " pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-cni-multus\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312151 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-kubelet\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312184 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-conf-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312196 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-kubelet\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctj69\" (UniqueName: \"kubernetes.io/projected/28ae5677-a4b3-45d0-ad63-57ce72ec178e-kube-api-access-ctj69\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312182 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-cni-multus\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312230 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-kubernetes\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312248 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-conf-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312255 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c137833-44bc-44d4-af02-8abe248d768b-agent-certs\") pod \"konnectivity-agent-47hlh\" (UID: \"3c137833-44bc-44d4-af02-8abe248d768b\") " pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-kubernetes\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.312888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47ca36d9-6678-40e0-bdb9-82b77f074535-dbus\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312319 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-daemon-config\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312339 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-etc-selinux\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-modprobe-d\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312367 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47ca36d9-6678-40e0-bdb9-82b77f074535-dbus\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-systemd\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-systemd\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312433 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-modprobe-d\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312450 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-socket-dir-parent\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312467 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-etc-selinux\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-multus-certs\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312511 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28ae5677-a4b3-45d0-ad63-57ce72ec178e-iptables-alerter-script\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312518 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-socket-dir-parent\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-lib-modules\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312560 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-cni-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312559 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-run-multus-certs\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cni-binary-copy\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.313701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-system-cni-dir\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312641 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-registration-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312645 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-cni-dir\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312657 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-lib-modules\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312664 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312700 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-sys\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312748 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f20681de-fd57-4b00-93b0-1f58c1dc6868-cni-binary-copy\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.312755 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312785 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-run\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312812 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-os-release\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-sys\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.312853 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:34.812812747 +0000 UTC m=+2.063510310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312889 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-registration-dir\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.312901 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312915 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f20681de-fd57-4b00-93b0-1f58c1dc6868-multus-daemon-config\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312930 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdqmq\" (UniqueName: \"kubernetes.io/projected/c65cf062-90d4-41de-a2e1-6be061576475-kube-api-access-zdqmq\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.314235 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.312959 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:34.812943014 +0000 UTC m=+2.063640570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-tmp\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312981 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-run\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-cni-bin\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313024 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/f20681de-fd57-4b00-93b0-1f58c1dc6868-kube-api-access-nhqcc\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313082 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28ae5677-a4b3-45d0-ad63-57ce72ec178e-iptables-alerter-script\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313082 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-os-release\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.312842 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-system-cni-dir\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313115 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-cni-binary-copy\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313111 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65cf062-90d4-41de-a2e1-6be061576475-tmp-dir\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-host-var-lib-cni-bin\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313169 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d87c275-3b60-46a1-ae16-8b8a83a371bc-serviceca\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysctl-d\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-tuned\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-os-release\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-etc-kubernetes\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313322 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-etc-kubernetes\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65cf062-90d4-41de-a2e1-6be061576475-tmp-dir\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.314859 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-sysctl-d\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.315363 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313439 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f20681de-fd57-4b00-93b0-1f58c1dc6868-cni-binary-copy\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.315363 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313463 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f20681de-fd57-4b00-93b0-1f58c1dc6868-os-release\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.315363 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.313543 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d87c275-3b60-46a1-ae16-8b8a83a371bc-serviceca\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.315363 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.314786 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c137833-44bc-44d4-af02-8abe248d768b-agent-certs\") pod \"konnectivity-agent-47hlh\" (UID: \"3c137833-44bc-44d4-af02-8abe248d768b\") " pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.315363 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.315017 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-tmp\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.315363 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.315246 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-etc-tuned\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.365020 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.364990 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jpl6p" Jun 11 09:34:34.370933 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.370909 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:34:34.370933 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.370930 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:34:34.371075 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.370940 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:34.371075 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.370990 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:34.870977226 +0000 UTC m=+2.121674783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:34.372818 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.372796 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq7lr\" (UniqueName: \"kubernetes.io/projected/b1ef8a4a-32f6-42a1-86d1-b3922d550a13-kube-api-access-jq7lr\") pod \"tuned-tz9wb\" (UID: \"b1ef8a4a-32f6-42a1-86d1-b3922d550a13\") " pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.373219 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.373197 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/f20681de-fd57-4b00-93b0-1f58c1dc6868-kube-api-access-nhqcc\") pod \"multus-mr5s7\" (UID: \"f20681de-fd57-4b00-93b0-1f58c1dc6868\") " pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.374221 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.374196 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctj69\" (UniqueName: \"kubernetes.io/projected/28ae5677-a4b3-45d0-ad63-57ce72ec178e-kube-api-access-ctj69\") pod \"iptables-alerter-ksjxk\" (UID: \"28ae5677-a4b3-45d0-ad63-57ce72ec178e\") " pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.374854 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.374834 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9s25\" (UniqueName: \"kubernetes.io/projected/aad8dd33-47b2-44a8-a6ad-50cf8e8a0316-kube-api-access-b9s25\") pod \"multus-additional-cni-plugins-h44sc\" (UID: \"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316\") " pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.374970 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.374954 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccdgn\" (UniqueName: \"kubernetes.io/projected/8d87c275-3b60-46a1-ae16-8b8a83a371bc-kube-api-access-ccdgn\") pod \"node-ca-5dhcg\" (UID: \"8d87c275-3b60-46a1-ae16-8b8a83a371bc\") " pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.375345 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.375324 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wkzv\" (UniqueName: \"kubernetes.io/projected/402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f-kube-api-access-5wkzv\") pod \"aws-ebs-csi-driver-node-f884t\" (UID: \"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.376032 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.376011 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdqmq\" (UniqueName: \"kubernetes.io/projected/c65cf062-90d4-41de-a2e1-6be061576475-kube-api-access-zdqmq\") pod \"node-resolver-c2dfw\" (UID: \"c65cf062-90d4-41de-a2e1-6be061576475\") " pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.381016 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.381000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n9m5\" (UniqueName: \"kubernetes.io/projected/b4f19fec-d824-439a-9722-e2af866a4010-kube-api-access-5n9m5\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.407683 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.407622 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jpl6p" Jun 11 09:34:34.429222 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.429202 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:34:34.436891 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.436872 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d57e6e7_b860_418b_bd61_b36fb2dacedb.slice/crio-7ef2c33a1703bcf96e59abf829d300bec9ed3085956a21bac3698210f5aebe90 WatchSource:0}: Error finding container 7ef2c33a1703bcf96e59abf829d300bec9ed3085956a21bac3698210f5aebe90: Status 404 returned error can't find the container with id 7ef2c33a1703bcf96e59abf829d300bec9ed3085956a21bac3698210f5aebe90 Jun 11 09:34:34.448187 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.448169 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h44sc" Jun 11 09:34:34.456182 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.456153 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad8dd33_47b2_44a8_a6ad_50cf8e8a0316.slice/crio-0f1acb98269e6f25d1b5dc3f29ef8639d52fd00c619281f156b7c63e66ed78fd WatchSource:0}: Error finding container 0f1acb98269e6f25d1b5dc3f29ef8639d52fd00c619281f156b7c63e66ed78fd: Status 404 returned error can't find the container with id 0f1acb98269e6f25d1b5dc3f29ef8639d52fd00c619281f156b7c63e66ed78fd Jun 11 09:34:34.471025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.471006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c2dfw" Jun 11 09:34:34.476991 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.476976 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5dhcg" Jun 11 09:34:34.478830 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.478810 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65cf062_90d4_41de_a2e1_6be061576475.slice/crio-4f0b8b9c56402e6e3a71b590d0232b9e0e4c246bc932874fea78ae9f1b7931a9 WatchSource:0}: Error finding container 4f0b8b9c56402e6e3a71b590d0232b9e0e4c246bc932874fea78ae9f1b7931a9: Status 404 returned error can't find the container with id 4f0b8b9c56402e6e3a71b590d0232b9e0e4c246bc932874fea78ae9f1b7931a9 Jun 11 09:34:34.483956 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.483941 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ksjxk" Jun 11 09:34:34.485491 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.485472 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d87c275_3b60_46a1_ae16_8b8a83a371bc.slice/crio-7709545c6272b41e8d005a464aa0b5e69b1f2ec5ec1a27a1f99519c8c5370b4d WatchSource:0}: Error finding container 7709545c6272b41e8d005a464aa0b5e69b1f2ec5ec1a27a1f99519c8c5370b4d: Status 404 returned error can't find the container with id 7709545c6272b41e8d005a464aa0b5e69b1f2ec5ec1a27a1f99519c8c5370b4d Jun 11 09:34:34.488671 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.488655 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" Jun 11 09:34:34.494750 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.493313 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ae5677_a4b3_45d0_ad63_57ce72ec178e.slice/crio-abcf047fcf4512ed5394f00474b5117bf183d94f707a262e164b12435bda89a9 WatchSource:0}: Error finding container abcf047fcf4512ed5394f00474b5117bf183d94f707a262e164b12435bda89a9: Status 404 returned error can't find the container with id abcf047fcf4512ed5394f00474b5117bf183d94f707a262e164b12435bda89a9 Jun 11 09:34:34.494750 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.493743 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:34.499924 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.499903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" Jun 11 09:34:34.500128 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.500104 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402e5beb_4c49_4e4c_aa44_f0b0c8b1a02f.slice/crio-acf0e445a9e425570ca3ebf1336fbff651065b6d5369b3992d404cd09b2025c0 WatchSource:0}: Error finding container acf0e445a9e425570ca3ebf1336fbff651065b6d5369b3992d404cd09b2025c0: Status 404 returned error can't find the container with id acf0e445a9e425570ca3ebf1336fbff651065b6d5369b3992d404cd09b2025c0 Jun 11 09:34:34.500200 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.500174 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 09:34:34.502304 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.502288 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c137833_44bc_44d4_af02_8abe248d768b.slice/crio-3e937253da2a8cc2c54cf2b2bdf64c654405e40819122c9a42c88ca1944bd281 WatchSource:0}: Error finding container 3e937253da2a8cc2c54cf2b2bdf64c654405e40819122c9a42c88ca1944bd281: Status 404 returned error can't find the container with id 3e937253da2a8cc2c54cf2b2bdf64c654405e40819122c9a42c88ca1944bd281 Jun 11 09:34:34.505488 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.505471 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr5s7" Jun 11 09:34:34.508508 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.508482 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ef8a4a_32f6_42a1_86d1_b3922d550a13.slice/crio-1cc11d9831e5d8d54d9d0c804bd92eda4e61331a645f45cf594d7afd63b061f3 WatchSource:0}: Error finding container 1cc11d9831e5d8d54d9d0c804bd92eda4e61331a645f45cf594d7afd63b061f3: Status 404 returned error can't find the container with id 1cc11d9831e5d8d54d9d0c804bd92eda4e61331a645f45cf594d7afd63b061f3 Jun 11 09:34:34.514945 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:34:34.514926 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20681de_fd57_4b00_93b0_1f58c1dc6868.slice/crio-c8d0f773b24d1db59fef69ce53a5f53a2c28ae032bea6f3a65165f2f4d411729 WatchSource:0}: Error finding container c8d0f773b24d1db59fef69ce53a5f53a2c28ae032bea6f3a65165f2f4d411729: Status 404 returned error can't find the container with id c8d0f773b24d1db59fef69ce53a5f53a2c28ae032bea6f3a65165f2f4d411729 Jun 11 09:34:34.816851 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.816746 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:34.816851 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.816809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:34.817068 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.816939 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:34.817068 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.816993 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:34.817068 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.817002 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:35.816984144 +0000 UTC m=+3.067681704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:34.817068 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.817065 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:35.817047154 +0000 UTC m=+3.067744724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:34.917661 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:34.917628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:34.917899 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.917883 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:34:34.917983 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.917906 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:34:34.917983 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.917918 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:34.918087 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:34.917990 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:35.917972621 +0000 UTC m=+3.168670194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:35.045307 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.045273 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 09:34:35.173356 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.172881 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:35.173356 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.173013 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:35.202941 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.202878 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47hlh" event={"ID":"3c137833-44bc-44d4-af02-8abe248d768b","Type":"ContainerStarted","Data":"3e937253da2a8cc2c54cf2b2bdf64c654405e40819122c9a42c88ca1944bd281"} Jun 11 09:34:35.212751 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.212717 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" event={"ID":"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f","Type":"ContainerStarted","Data":"acf0e445a9e425570ca3ebf1336fbff651065b6d5369b3992d404cd09b2025c0"} Jun 11 09:34:35.234430 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.234383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerStarted","Data":"0f1acb98269e6f25d1b5dc3f29ef8639d52fd00c619281f156b7c63e66ed78fd"} Jun 11 09:34:35.234751 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.234720 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 09:34:35.250310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.250277 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"7ef2c33a1703bcf96e59abf829d300bec9ed3085956a21bac3698210f5aebe90"} Jun 11 09:34:35.268833 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.268800 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr5s7" event={"ID":"f20681de-fd57-4b00-93b0-1f58c1dc6868","Type":"ContainerStarted","Data":"c8d0f773b24d1db59fef69ce53a5f53a2c28ae032bea6f3a65165f2f4d411729"} Jun 11 09:34:35.292447 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.292409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" event={"ID":"b1ef8a4a-32f6-42a1-86d1-b3922d550a13","Type":"ContainerStarted","Data":"1cc11d9831e5d8d54d9d0c804bd92eda4e61331a645f45cf594d7afd63b061f3"} Jun 11 09:34:35.306929 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.306882 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ksjxk" event={"ID":"28ae5677-a4b3-45d0-ad63-57ce72ec178e","Type":"ContainerStarted","Data":"abcf047fcf4512ed5394f00474b5117bf183d94f707a262e164b12435bda89a9"} Jun 11 09:34:35.326013 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.325973 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5dhcg" event={"ID":"8d87c275-3b60-46a1-ae16-8b8a83a371bc","Type":"ContainerStarted","Data":"7709545c6272b41e8d005a464aa0b5e69b1f2ec5ec1a27a1f99519c8c5370b4d"} Jun 11 09:34:35.340070 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.340036 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2dfw" event={"ID":"c65cf062-90d4-41de-a2e1-6be061576475","Type":"ContainerStarted","Data":"4f0b8b9c56402e6e3a71b590d0232b9e0e4c246bc932874fea78ae9f1b7931a9"} Jun 11 09:34:35.365219 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.365156 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"3a4d0037bc836100039b5ba89f25455a","Type":"ContainerStarted","Data":"4e555aa70bb42485a5941894ca7d73beb9fa9f239c087791729543ca4dd77609"} Jun 11 09:34:35.374883 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.374837 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" event={"ID":"7e3975a94ce874e15a33ae15093f7df3","Type":"ContainerStarted","Data":"2710ad6f4918e7a04161feefcf967eaeaabb9602171151ba4864d5cbb46c7942"} Jun 11 09:34:35.411777 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.411722 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 09:29:34 +0000 UTC" deadline="2027-11-29 08:34:56.280624444 +0000 UTC" Jun 11 09:34:35.411777 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.411775 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12863h0m20.868854644s" Jun 11 09:34:35.824283 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.824247 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:35.824477 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.824298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:35.824477 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.824434 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:35.824599 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.824495 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:37.824477352 +0000 UTC m=+5.075174913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:35.824599 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.824559 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:35.824599 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.824600 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:37.824587906 +0000 UTC m=+5.075285466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:35.925609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:35.925565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:35.925816 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.925735 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:34:35.925816 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.925769 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:34:35.925816 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.925785 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:35.925975 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:35.925844 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:37.925826587 +0000 UTC m=+5.176524146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:36.170887 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:36.170851 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:36.171343 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:36.170978 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:36.171470 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:36.171451 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:36.171612 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:36.171563 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:36.412071 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:36.411998 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 09:29:34 +0000 UTC" deadline="2028-01-05 17:07:32.529589434 +0000 UTC" Jun 11 09:34:36.412071 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:36.412035 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13759h32m56.117559117s" Jun 11 09:34:36.684349 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:36.684061 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 09:34:37.171349 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:37.170827 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:37.171349 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.170966 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:37.842850 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:37.842808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:37.843033 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:37.842863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:37.843033 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.843007 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:37.843162 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.843065 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:37.843162 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.843084 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:41.843062829 +0000 UTC m=+9.093760386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:37.843162 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.843132 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:41.843104134 +0000 UTC m=+9.093801693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:37.943704 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:37.943629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:37.943910 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.943833 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:34:37.943910 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.943860 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:34:37.943910 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.943874 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:37.944041 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:37.943939 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:41.943919379 +0000 UTC m=+9.194616939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:38.170807 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:38.170329 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:38.170807 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:38.170447 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:38.170807 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:38.170495 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:38.170807 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:38.170609 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:39.171828 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:39.171751 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:39.172270 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:39.171901 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:40.171277 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:40.171170 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:40.171277 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:40.171170 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:40.171536 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:40.171309 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:40.171536 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:40.171398 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:41.176599 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:41.176561 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:41.177150 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.176695 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:41.878514 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:41.878475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:41.878682 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:41.878521 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:41.878682 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.878626 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:41.878682 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.878682 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:49.878668386 +0000 UTC m=+17.129365942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:41.879103 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.879085 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:41.879185 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.879144 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:49.879129606 +0000 UTC m=+17.129827162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:41.979497 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:41.979252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:41.979497 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.979406 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:34:41.979497 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.979423 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:34:41.979497 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.979435 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:41.979497 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:41.979493 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:34:49.979476258 +0000 UTC m=+17.230173840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:42.171215 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:42.171123 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:42.171366 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:42.171277 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:42.171605 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:42.171542 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:42.171723 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:42.171667 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:43.172051 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:43.172018 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:43.172481 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:43.172130 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:44.170906 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:44.170869 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:44.171096 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:44.170869 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:44.171096 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:44.171023 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:44.171209 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:44.171122 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:45.170777 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:45.170728 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:45.171218 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:45.170854 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:46.171024 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:46.170993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:46.171412 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:46.170999 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:46.171412 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:46.171141 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:46.171412 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:46.171228 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:47.171411 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:47.171189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:47.171966 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:47.171514 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:48.170674 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:48.170645 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:48.170856 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:48.170645 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:48.170856 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:48.170799 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:48.170981 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:48.170865 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:49.173926 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:49.173896 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:49.174389 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:49.173996 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:49.943749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:49.943710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:49.943749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:49.943770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:49.944029 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:49.943878 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:49.944029 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:49.943916 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:49.944029 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:49.943947 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:05.943929887 +0000 UTC m=+33.194627446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:34:49.944029 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:49.943966 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:05.943953934 +0000 UTC m=+33.194651494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:34:50.045183 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:50.045104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:50.045373 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:50.045297 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:34:50.045373 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:50.045321 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:34:50.045373 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:50.045335 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:50.045502 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:50.045390 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:06.045376806 +0000 UTC m=+33.296074366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:34:50.171102 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:50.171065 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:50.171331 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:50.171191 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:50.171331 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:50.171248 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:50.171432 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:50.171362 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:51.171017 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:51.170979 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:51.171471 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:51.171144 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:52.171431 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:52.171386 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:52.171914 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:52.171538 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:52.171914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:52.171599 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:52.171914 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:52.171725 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:53.171528 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:53.171496 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:53.172010 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:53.171595 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:54.171191 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:54.171165 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:54.171313 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:54.171262 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:54.171367 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:54.171318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:54.171416 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:54.171399 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:55.173161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.172992 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:55.173871 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:55.173259 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:55.420950 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.420850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr5s7" event={"ID":"f20681de-fd57-4b00-93b0-1f58c1dc6868","Type":"ContainerStarted","Data":"77130c470ccd430406526ec94eb61b4f72232be746767498bb0398ffcc8b498c"} Jun 11 09:34:55.422392 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.422363 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" event={"ID":"b1ef8a4a-32f6-42a1-86d1-b3922d550a13","Type":"ContainerStarted","Data":"f3d2ed9eead713ac29282130edf4552e7c257de4e0d23b3b2cddba3d92ec5341"} Jun 11 09:34:55.423680 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.423657 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5dhcg" event={"ID":"8d87c275-3b60-46a1-ae16-8b8a83a371bc","Type":"ContainerStarted","Data":"9a8074bc648e2cd81f4202b7b4b9dc554cb96dd52087dc8b663002b2a80bd753"} Jun 11 09:34:55.425136 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.425106 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c2dfw" event={"ID":"c65cf062-90d4-41de-a2e1-6be061576475","Type":"ContainerStarted","Data":"f8b6448a5b157b9abc0030b64d009bc18d022cf34a3d307edff794b0af6215b9"} Jun 11 09:34:55.426501 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.426481 2557 generic.go:356] "Generic (PLEG): container finished" podID="3a4d0037bc836100039b5ba89f25455a" containerID="3ee979eed9b37095a78f9f704863ff9bb3e1157e579081e01f0015a83ec00daa" exitCode=0 Jun 11 09:34:55.426609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.426542 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"3a4d0037bc836100039b5ba89f25455a","Type":"ContainerDied","Data":"3ee979eed9b37095a78f9f704863ff9bb3e1157e579081e01f0015a83ec00daa"} Jun 11 09:34:55.427934 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.427916 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" event={"ID":"7e3975a94ce874e15a33ae15093f7df3","Type":"ContainerStarted","Data":"3205d285b78e38960f0e3e4c1dd087aa737b37f4f9203bb496f1dc96d4656700"} Jun 11 09:34:55.429303 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.429281 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-47hlh" event={"ID":"3c137833-44bc-44d4-af02-8abe248d768b","Type":"ContainerStarted","Data":"fb822429fb27ec70a90702de6ae6c6b33dc26740912e9fbc3173029cc8a17fb1"} Jun 11 09:34:55.430594 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.430577 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" event={"ID":"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f","Type":"ContainerStarted","Data":"efcb9d1ea3c8ebc64e0a223ad4a3b62c419728e6c4e4855a30c0aa0ebff344d5"} Jun 11 09:34:55.431805 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.431784 2557 generic.go:356] "Generic (PLEG): container finished" podID="aad8dd33-47b2-44a8-a6ad-50cf8e8a0316" containerID="55895a4fce7ba7259fedc875cdaefcd697e1104487861e8d47008bf47ff03618" exitCode=0 Jun 11 09:34:55.431890 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.431851 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerDied","Data":"55895a4fce7ba7259fedc875cdaefcd697e1104487861e8d47008bf47ff03618"} Jun 11 09:34:55.438064 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.438043 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"d1523001d6d73ec8225698d5d7107e6f8ea0d668ba6d5e3cca8192b9e7b08681"} Jun 11 09:34:55.438148 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.438128 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"8a09ca0f09edd2ee92f82ee509df13e24cbb595eb1563b40f0155cffdffdc8f3"} Jun 11 09:34:55.438187 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.438160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"63421ba7c61bf50cbdb278c71798cec0c7654527002135627eadaad16d3e6c8c"} Jun 11 09:34:55.438220 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.438194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"278170e83a129c8f9da4171bfb39609770902c813de71dbad9d3c838ec7ebe5a"} Jun 11 09:34:55.438252 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.438222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"cc6ad2b728444a0ea3b7dadb3a4bf78caa221eb0cc8b7e058bb99bf865609401"} Jun 11 09:34:55.438252 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.438247 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"4e3232a4789d1512bfa116670fd01f228cca56c16375ce104c56eeb6f1f4fcf5"} Jun 11 09:34:55.505988 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.505687 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mr5s7" podStartSLOduration=2.601208411 podStartE2EDuration="22.505665868s" totalImagesPullingTime="19.904457457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.442693529 +0000 UTC m=+22.693391108" watchObservedRunningTime="2026-06-11 09:34:55.505665868 +0000 UTC m=+22.756363447" Jun 11 09:34:55.591687 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.591640 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tz9wb" podStartSLOduration=2.755091245 podStartE2EDuration="22.591623306s" totalImagesPullingTime="19.836532061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.54124991 +0000 UTC m=+22.791947488" watchObservedRunningTime="2026-06-11 09:34:55.591623306 +0000 UTC m=+22.842320884" Jun 11 09:34:55.662372 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.662322 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c2dfw" podStartSLOduration=2.720364824 podStartE2EDuration="22.662303916s" totalImagesPullingTime="19.941939092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.662149053 +0000 UTC m=+22.912846632" watchObservedRunningTime="2026-06-11 09:34:55.662303916 +0000 UTC m=+22.913001494" Jun 11 09:34:55.662637 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.662616 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-96.ec2.internal" podStartSLOduration=21.662609207 podStartE2EDuration="21.662609207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.640535521 +0000 UTC m=+22.891233099" watchObservedRunningTime="2026-06-11 09:34:55.662609207 +0000 UTC m=+22.913306784" Jun 11 09:34:55.687576 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.687454 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5dhcg" podStartSLOduration=2.828350833 podStartE2EDuration="22.687436381s" totalImagesPullingTime="19.859085548s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.687073677 +0000 UTC m=+22.937771257" watchObservedRunningTime="2026-06-11 09:34:55.687436381 +0000 UTC m=+22.938133961" Jun 11 09:34:55.722634 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:55.722580 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-47hlh" podStartSLOduration=2.8483460369999998 podStartE2EDuration="22.722561962s" totalImagesPullingTime="19.874215925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:55.722278755 +0000 UTC m=+22.972976335" watchObservedRunningTime="2026-06-11 09:34:55.722561962 +0000 UTC m=+22.973259541" Jun 11 09:34:56.171183 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:56.171155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:56.171361 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:56.171154 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:56.171361 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:56.171307 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:56.171473 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:56.171367 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:56.442568 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:56.442533 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ksjxk" event={"ID":"28ae5677-a4b3-45d0-ad63-57ce72ec178e","Type":"ContainerStarted","Data":"79338b87033e679121ddc2173b6656ad69a72eab08f9cca268a3d79b7a79b9d6"} Jun 11 09:34:56.444802 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:56.444724 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" event={"ID":"3a4d0037bc836100039b5ba89f25455a","Type":"ContainerStarted","Data":"7b2dc21da1efde81632120836f9d4fe7fb1fceaf8233616a907dd183fecc7bc7"} Jun 11 09:34:56.467663 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:56.467618 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ksjxk" podStartSLOduration=3.5414436670000002 podStartE2EDuration="23.467599184s" totalImagesPullingTime="19.926155517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:56.458410912 +0000 UTC m=+23.709108489" watchObservedRunningTime="2026-06-11 09:34:56.467599184 +0000 UTC m=+23.718296764" Jun 11 09:34:56.555379 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:56.555353 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 09:34:57.170862 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.170831 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:57.171034 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:57.170965 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:34:57.173582 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.173435 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T09:34:56.555373594Z","UUID":"dca18d7b-f0f1-4461-9466-1832ae337a6f","Handler":null,"Name":"","Endpoint":""} Jun 11 09:34:57.175442 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.175419 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 09:34:57.175552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.175465 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 09:34:57.449649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.449573 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" event={"ID":"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f","Type":"ContainerStarted","Data":"194b290960db8d017b790b730450a91df27c23d31726480997d649a5b59e0564"} Jun 11 09:34:57.453827 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.453791 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"67df25cd969c2ebc8336db032912b567c2507ee3dce2417c75f575f77ecffc88"} Jun 11 09:34:57.857428 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.857398 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:57.858246 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.858227 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:57.877059 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:57.877008 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-96.ec2.internal" podStartSLOduration=23.876990298 podStartE2EDuration="23.876990298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:56.475833705 +0000 UTC m=+23.726531283" watchObservedRunningTime="2026-06-11 09:34:57.876990298 +0000 UTC m=+25.127687880" Jun 11 09:34:58.171169 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:58.171095 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:34:58.171321 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:58.171097 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:34:58.171321 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:58.171224 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:34:58.171321 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:58.171304 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:34:58.458116 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:58.458034 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" event={"ID":"402e5beb-4c49-4e4c-aa44-f0b0c8b1a02f","Type":"ContainerStarted","Data":"f6987c022aee44d6a1c73755f10db78e05a1c5e56969feb9e241634312cab94c"} Jun 11 09:34:58.458582 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:58.458192 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:58.458875 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:58.458857 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-47hlh" Jun 11 09:34:58.478287 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:58.478235 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f884t" podStartSLOduration=3.416219595 podStartE2EDuration="25.478216919s" totalImagesPullingTime="22.061997324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:34:58.477126428 +0000 UTC m=+25.727824006" watchObservedRunningTime="2026-06-11 09:34:58.478216919 +0000 UTC m=+25.728914497" Jun 11 09:34:59.171060 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:34:59.171024 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:34:59.171236 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:34:59.171173 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:35:00.170979 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.170799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:00.171610 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.170799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:00.171610 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:00.171059 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:35:00.171610 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:00.171148 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:35:00.464655 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.464559 2557 generic.go:356] "Generic (PLEG): container finished" podID="aad8dd33-47b2-44a8-a6ad-50cf8e8a0316" containerID="356327b530510588994cc11160a4e4b92257b7b26a6772e72e595f65e3647efb" exitCode=0 Jun 11 09:35:00.464655 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.464619 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerDied","Data":"356327b530510588994cc11160a4e4b92257b7b26a6772e72e595f65e3647efb"} Jun 11 09:35:00.468371 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.468344 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" event={"ID":"4d57e6e7-b860-418b-bd61-b36fb2dacedb","Type":"ContainerStarted","Data":"ab975824870a336d1c63070cca2ac2b5c9c45b559bd7758b10b62ed6579f6a85"} Jun 11 09:35:00.468581 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.468556 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:35:00.524341 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:00.524287 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" podStartSLOduration=7.422760896 podStartE2EDuration="27.524272035s" totalImagesPullingTime="20.101511139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:00.523314032 +0000 UTC m=+27.774011610" watchObservedRunningTime="2026-06-11 09:35:00.524272035 +0000 UTC m=+27.774969613" Jun 11 09:35:01.171128 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.171099 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:01.171744 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:01.171232 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:35:01.470740 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.470526 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:35:01.470909 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.470810 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:35:01.486641 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.486618 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:35:01.486875 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.486860 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:35:01.557127 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.557102 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjddd"] Jun 11 09:35:01.557301 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.557227 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:01.557373 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:01.557304 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:35:01.560528 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.560477 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lcnlh"] Jun 11 09:35:01.560650 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.560613 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:01.560749 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:01.560727 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:35:01.561133 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.561113 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzf96"] Jun 11 09:35:01.561222 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:01.561210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:01.561318 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:01.561299 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:35:02.474144 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:02.474111 2557 generic.go:356] "Generic (PLEG): container finished" podID="aad8dd33-47b2-44a8-a6ad-50cf8e8a0316" containerID="6a97dcb6f0012ad59eec60d156d43a547527c06c54c387a8d5d3dbe58fc2c31b" exitCode=0 Jun 11 09:35:02.474619 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:02.474194 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerDied","Data":"6a97dcb6f0012ad59eec60d156d43a547527c06c54c387a8d5d3dbe58fc2c31b"} Jun 11 09:35:03.172414 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:03.172376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:03.172590 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:03.172482 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:03.172590 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:03.172511 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:03.172590 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:03.172519 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:35:03.172717 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:03.172593 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:35:03.172717 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:03.172675 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:35:04.481338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:04.481102 2557 generic.go:356] "Generic (PLEG): container finished" podID="aad8dd33-47b2-44a8-a6ad-50cf8e8a0316" containerID="8f7598595d012c85811a0639cf26181ca6f9908b99cf0a63f6f7386f63cd44c9" exitCode=0 Jun 11 09:35:04.481338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:04.481181 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerDied","Data":"8f7598595d012c85811a0639cf26181ca6f9908b99cf0a63f6f7386f63cd44c9"} Jun 11 09:35:05.171001 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:05.170950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:05.171169 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:05.170950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:05.171169 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.171090 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzf96" podUID="cf5a331e-9396-4059-aeaf-61c462327270" Jun 11 09:35:05.171169 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:05.170950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:05.171301 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.171191 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:35:05.171301 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.171267 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rjddd" podUID="47ca36d9-6678-40e0-bdb9-82b77f074535" Jun 11 09:35:05.963507 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:05.963469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:05.963507 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:05.963509 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:05.964019 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.963620 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 09:35:05.964019 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.963630 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:35:05.964019 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.963675 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret podName:47ca36d9-6678-40e0-bdb9-82b77f074535 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:37.963658614 +0000 UTC m=+65.214356171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret") pod "global-pull-secret-syncer-rjddd" (UID: "47ca36d9-6678-40e0-bdb9-82b77f074535") : object "kube-system"/"original-pull-secret" not registered Jun 11 09:35:05.964019 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:05.963689 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:37.963682779 +0000 UTC m=+65.214380335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 09:35:06.063978 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:06.063946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:06.064225 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:06.064140 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 09:35:06.064225 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:06.064159 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 09:35:06.064225 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:06.064169 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zfv5h for pod openshift-network-diagnostics/network-check-target-fzf96: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:35:06.064353 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:06.064227 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h podName:cf5a331e-9396-4059-aeaf-61c462327270 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:38.064211168 +0000 UTC m=+65.314908723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zfv5h" (UniqueName: "kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h") pod "network-check-target-fzf96" (UID: "cf5a331e-9396-4059-aeaf-61c462327270") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 09:35:07.064358 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.064331 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-96.ec2.internal" event="NodeReady" Jun 11 09:35:07.064927 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.064472 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 09:35:07.107020 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.106988 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6jjjr"] Jun 11 09:35:07.109516 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.109492 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qjrrn"] Jun 11 09:35:07.109645 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.109617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.111315 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.111295 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.112050 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.112020 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 09:35:07.112050 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.112026 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgk2h\"" Jun 11 09:35:07.112232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.112121 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 09:35:07.113701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.113680 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 09:35:07.113863 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.113845 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8pc9t\"" Jun 11 09:35:07.113957 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.113935 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 09:35:07.114013 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.113956 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 09:35:07.118582 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.118562 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jjjr"] Jun 11 09:35:07.119982 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.119963 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qjrrn"] Jun 11 09:35:07.170784 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.170733 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:07.170962 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.170887 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:07.171033 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.170988 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:07.173779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.173736 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 09:35:07.173977 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.173962 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5m9lf\"" Jun 11 09:35:07.173977 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.173962 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 09:35:07.174128 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.174040 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fdlt8\"" Jun 11 09:35:07.174128 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.174094 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 09:35:07.174301 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.174281 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 09:35:07.273309 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.273226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/909b7c22-55ba-428c-b4fd-78e1f23b3268-config-volume\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.273309 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.273264 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/909b7c22-55ba-428c-b4fd-78e1f23b3268-tmp-dir\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.273309 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.273308 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f71ddba-ddd0-4c68-8627-c16833b90bb1-cert\") pod \"ingress-canary-qjrrn\" (UID: \"6f71ddba-ddd0-4c68-8627-c16833b90bb1\") " pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.273551 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.273334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj5wl\" (UniqueName: \"kubernetes.io/projected/6f71ddba-ddd0-4c68-8627-c16833b90bb1-kube-api-access-pj5wl\") pod \"ingress-canary-qjrrn\" (UID: \"6f71ddba-ddd0-4c68-8627-c16833b90bb1\") " pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.273551 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.273357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9s4d\" (UniqueName: \"kubernetes.io/projected/909b7c22-55ba-428c-b4fd-78e1f23b3268-kube-api-access-w9s4d\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.273551 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.273391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.374485 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.374450 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f71ddba-ddd0-4c68-8627-c16833b90bb1-cert\") pod \"ingress-canary-qjrrn\" (UID: \"6f71ddba-ddd0-4c68-8627-c16833b90bb1\") " pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.374485 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.374495 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj5wl\" (UniqueName: \"kubernetes.io/projected/6f71ddba-ddd0-4c68-8627-c16833b90bb1-kube-api-access-pj5wl\") pod \"ingress-canary-qjrrn\" (UID: \"6f71ddba-ddd0-4c68-8627-c16833b90bb1\") " pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.374734 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.374523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9s4d\" (UniqueName: \"kubernetes.io/projected/909b7c22-55ba-428c-b4fd-78e1f23b3268-kube-api-access-w9s4d\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.374734 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.374561 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.374734 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:07.374673 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:07.374734 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:07.374730 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:07.87471077 +0000 UTC m=+35.125408327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:07.374734 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.374722 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/909b7c22-55ba-428c-b4fd-78e1f23b3268-config-volume\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.375007 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.374778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/909b7c22-55ba-428c-b4fd-78e1f23b3268-tmp-dir\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.375143 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.375124 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/909b7c22-55ba-428c-b4fd-78e1f23b3268-tmp-dir\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.375212 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.375193 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/909b7c22-55ba-428c-b4fd-78e1f23b3268-config-volume\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.379117 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.379093 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f71ddba-ddd0-4c68-8627-c16833b90bb1-cert\") pod \"ingress-canary-qjrrn\" (UID: \"6f71ddba-ddd0-4c68-8627-c16833b90bb1\") " pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.385956 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.385920 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj5wl\" (UniqueName: \"kubernetes.io/projected/6f71ddba-ddd0-4c68-8627-c16833b90bb1-kube-api-access-pj5wl\") pod \"ingress-canary-qjrrn\" (UID: \"6f71ddba-ddd0-4c68-8627-c16833b90bb1\") " pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.387931 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.387912 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9s4d\" (UniqueName: \"kubernetes.io/projected/909b7c22-55ba-428c-b4fd-78e1f23b3268-kube-api-access-w9s4d\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.428868 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.428819 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qjrrn" Jun 11 09:35:07.878278 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:07.878246 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:07.878450 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:07.878378 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:07.878450 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:07.878446 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:08.878430076 +0000 UTC m=+36.129127633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:08.616849 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:08.616666 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qjrrn"] Jun 11 09:35:08.620025 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:35:08.619991 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f71ddba_ddd0_4c68_8627_c16833b90bb1.slice/crio-1af1bb4e19b32b575891f2c1ebdfcde12ec040fdead56938108670bbc832220b WatchSource:0}: Error finding container 1af1bb4e19b32b575891f2c1ebdfcde12ec040fdead56938108670bbc832220b: Status 404 returned error can't find the container with id 1af1bb4e19b32b575891f2c1ebdfcde12ec040fdead56938108670bbc832220b Jun 11 09:35:08.888829 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:08.888798 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:08.889006 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:08.888946 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:08.889054 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:08.889011 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:10.888995123 +0000 UTC m=+38.139692679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:09.495773 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:09.495723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qjrrn" event={"ID":"6f71ddba-ddd0-4c68-8627-c16833b90bb1","Type":"ContainerStarted","Data":"1af1bb4e19b32b575891f2c1ebdfcde12ec040fdead56938108670bbc832220b"} Jun 11 09:35:09.498812 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:09.498786 2557 generic.go:356] "Generic (PLEG): container finished" podID="aad8dd33-47b2-44a8-a6ad-50cf8e8a0316" containerID="674bb63a3d96cac95af2cae0e31e4c441eb10bf221af5fd2bf29d799172f7b8d" exitCode=0 Jun 11 09:35:09.498967 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:09.498849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerDied","Data":"674bb63a3d96cac95af2cae0e31e4c441eb10bf221af5fd2bf29d799172f7b8d"} Jun 11 09:35:10.502339 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.502306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qjrrn" event={"ID":"6f71ddba-ddd0-4c68-8627-c16833b90bb1","Type":"ContainerStarted","Data":"f9c6ed9ab912e0fedf22833f1625b306608d3bc6272629af0c4386531d48e514"} Jun 11 09:35:10.505333 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.505304 2557 generic.go:356] "Generic (PLEG): container finished" podID="aad8dd33-47b2-44a8-a6ad-50cf8e8a0316" containerID="e93cfc5497c8baee3c7068d4fc0ba522b1af4eba1fbfead9380899b9f579c92e" exitCode=0 Jun 11 09:35:10.505459 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.505341 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerDied","Data":"e93cfc5497c8baee3c7068d4fc0ba522b1af4eba1fbfead9380899b9f579c92e"} Jun 11 09:35:10.521698 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.521659 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qjrrn" podStartSLOduration=2.038607882 podStartE2EDuration="3.521644658s" totalImagesPullingTime="1.483036776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:10.52062485 +0000 UTC m=+37.771322428" watchObservedRunningTime="2026-06-11 09:35:10.521644658 +0000 UTC m=+37.772342213" Jun 11 09:35:10.553338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.553302 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:10.697124 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.697086 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:10.903802 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:10.903753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:10.903959 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:10.903900 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:10.904009 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:10.903967 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:14.903951323 +0000 UTC m=+42.154648884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:11.012134 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.012105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:11.096355 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.096325 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:11.510966 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.510929 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h44sc" event={"ID":"aad8dd33-47b2-44a8-a6ad-50cf8e8a0316","Type":"ContainerStarted","Data":"4c716e1ea199d772c097159f188ef66f40cdad9790065920f191355e44122214"} Jun 11 09:35:11.542516 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.542466 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h44sc" podStartSLOduration=8.283587286 podStartE2EDuration="38.542451451s" totalImagesPullingTime="30.258864165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:11.540985691 +0000 UTC m=+38.791683269" watchObservedRunningTime="2026-06-11 09:35:11.542451451 +0000 UTC m=+38.793149029" Jun 11 09:35:11.674044 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.674009 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:11.852790 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.852746 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:11.995415 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:11.995380 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:12.142248 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:12.142168 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:12.895462 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:12.895426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:12.963887 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:12.963847 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:14.931003 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:14.930962 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:14.931366 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:14.931068 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:14.931366 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:14.931119 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:22.931107 +0000 UTC m=+50.181804556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:22.987135 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:22.987094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:22.987998 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:22.987253 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:22.987998 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:22.987321 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:35:38.987305336 +0000 UTC m=+66.238002892 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:32.683971 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:32.683931 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:32.784171 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:32.784140 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:33.494673 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:33.494645 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jcpx7" Jun 11 09:35:33.508616 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:33.508585 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:33.619446 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:33.619414 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:33.709345 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:33.709316 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:34.065405 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:34.065378 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:34.179349 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:34.179322 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:37.985352 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:37.985299 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:35:37.985352 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:37.985352 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:37.988163 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:37.988146 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 09:35:37.988214 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:37.988150 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 09:35:37.996241 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:37.996222 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 09:35:37.996344 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:37.996332 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:36:41.996310349 +0000 UTC m=+129.247007917 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : secret "metrics-daemon-secret" not found Jun 11 09:35:37.999939 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:37.999910 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47ca36d9-6678-40e0-bdb9-82b77f074535-original-pull-secret\") pod \"global-pull-secret-syncer-rjddd\" (UID: \"47ca36d9-6678-40e0-bdb9-82b77f074535\") " pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:38.082856 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.082809 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rjddd" Jun 11 09:35:38.086100 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.086071 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:38.089589 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.089562 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 09:35:38.099492 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.099470 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 09:35:38.109376 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.109350 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfv5h\" (UniqueName: \"kubernetes.io/projected/cf5a331e-9396-4059-aeaf-61c462327270-kube-api-access-zfv5h\") pod \"network-check-target-fzf96\" (UID: \"cf5a331e-9396-4059-aeaf-61c462327270\") " pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:38.206777 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.206731 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rjddd"] Jun 11 09:35:38.210393 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:35:38.210367 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ca36d9_6678_40e0_bdb9_82b77f074535.slice/crio-4f57798946517d2db51cc98be9555f6608145140cb7eeddfe47c29ecf7fb01d3 WatchSource:0}: Error finding container 4f57798946517d2db51cc98be9555f6608145140cb7eeddfe47c29ecf7fb01d3: Status 404 returned error can't find the container with id 4f57798946517d2db51cc98be9555f6608145140cb7eeddfe47c29ecf7fb01d3 Jun 11 09:35:38.399203 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.399174 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5m9lf\"" Jun 11 09:35:38.407334 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.407317 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:38.528777 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.528728 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzf96"] Jun 11 09:35:38.531821 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:35:38.531793 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5a331e_9396_4059_aeaf_61c462327270.slice/crio-da6bcd42ac8c8718cbb4d16a697a668930808f9993b630501850048bae2db77b WatchSource:0}: Error finding container da6bcd42ac8c8718cbb4d16a697a668930808f9993b630501850048bae2db77b: Status 404 returned error can't find the container with id da6bcd42ac8c8718cbb4d16a697a668930808f9993b630501850048bae2db77b Jun 11 09:35:38.573056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.573027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzf96" event={"ID":"cf5a331e-9396-4059-aeaf-61c462327270","Type":"ContainerStarted","Data":"da6bcd42ac8c8718cbb4d16a697a668930808f9993b630501850048bae2db77b"} Jun 11 09:35:38.573976 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.573950 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjddd" event={"ID":"47ca36d9-6678-40e0-bdb9-82b77f074535","Type":"ContainerStarted","Data":"4f57798946517d2db51cc98be9555f6608145140cb7eeddfe47c29ecf7fb01d3"} Jun 11 09:35:38.993263 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:38.993212 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:35:38.993699 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:38.993379 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:35:38.993699 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:35:38.993460 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:36:10.993436339 +0000 UTC m=+98.244133919 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:35:43.590369 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:43.590335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzf96" event={"ID":"cf5a331e-9396-4059-aeaf-61c462327270","Type":"ContainerStarted","Data":"4814d7fd2f5d9e46b6504f1336fb2084597dd2732986045bc98e248aba757328"} Jun 11 09:35:43.590833 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:43.590470 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:35:43.591848 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:43.591824 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rjddd" event={"ID":"47ca36d9-6678-40e0-bdb9-82b77f074535","Type":"ContainerStarted","Data":"8216222fae68c492eb0b1298571f3ec953213b5641910a65adb47bf6cc033aa1"} Jun 11 09:35:43.656315 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:43.656268 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rjddd" podStartSLOduration=66.01226181 podStartE2EDuration="1m10.65625033s" totalImagesPullingTime="4.64398852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:43.655013721 +0000 UTC m=+70.905711299" watchObservedRunningTime="2026-06-11 09:35:43.65625033 +0000 UTC m=+70.906947907" Jun 11 09:35:43.656463 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:43.656426 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fzf96" podStartSLOduration=66.337742909 podStartE2EDuration="1m10.656418847s" totalImagesPullingTime="4.318675938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:35:43.623702801 +0000 UTC m=+70.874400414" watchObservedRunningTime="2026-06-11 09:35:43.656418847 +0000 UTC m=+70.907116426" Jun 11 09:35:46.844991 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:46.844872 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:35:46.946395 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:35:46.946359 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:36:11.014001 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:36:11.013957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:36:11.014509 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:36:11.014075 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:36:11.014509 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:36:11.014132 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:37:15.014116 +0000 UTC m=+162.264813568 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:36:14.597301 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:36:14.597269 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fzf96" Jun 11 09:36:42.017132 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:36:42.017085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:36:42.017603 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:36:42.017255 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 09:36:42.017603 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:36:42.017351 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs podName:b4f19fec-d824-439a-9722-e2af866a4010 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:44.01733324 +0000 UTC m=+251.268030800 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs") pod "network-metrics-daemon-lcnlh" (UID: "b4f19fec-d824-439a-9722-e2af866a4010") : secret "metrics-daemon-secret" not found Jun 11 09:36:42.131122 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:36:42.131087 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:37:10.123334 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:37:10.123283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6jjjr" podUID="909b7c22-55ba-428c-b4fd-78e1f23b3268" Jun 11 09:37:10.190462 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:37:10.190416 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lcnlh" podUID="b4f19fec-d824-439a-9722-e2af866a4010" Jun 11 09:37:10.793619 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:37:10.793587 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jjjr" Jun 11 09:37:15.037999 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:37:15.037957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:37:15.038479 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:37:15.038118 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 09:37:15.038479 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:37:15.038197 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls podName:909b7c22-55ba-428c-b4fd-78e1f23b3268 nodeName:}" failed. No retries permitted until 2026-06-11 09:39:17.038178509 +0000 UTC m=+284.288876065 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls") pod "dns-default-6jjjr" (UID: "909b7c22-55ba-428c-b4fd-78e1f23b3268") : secret "dns-default-metrics-tls" not found Jun 11 09:37:23.171667 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:37:23.171569 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:38:04.217469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:04.217369 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:14.115157 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.115116 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb"] Jun 11 09:38:14.117237 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.117213 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-2fc2c"] Jun 11 09:38:14.117421 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.117402 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.119446 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.119413 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74684f8cf7-t4cr5"] Jun 11 09:38:14.120881 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.120859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.122336 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.122291 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 09:38:14.122608 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.122591 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 09:38:14.122771 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.122743 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 09:38:14.122888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.122872 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vvxph\"" Jun 11 09:38:14.124110 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.124093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.128828 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.128809 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 09:38:14.128928 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.128855 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 09:38:14.129011 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.128994 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 09:38:14.129125 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.128994 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sxn4r\"" Jun 11 09:38:14.129125 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.129049 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 09:38:14.129125 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.129065 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5m74q\"" Jun 11 09:38:14.129287 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.129153 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 09:38:14.129287 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.129188 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 09:38:14.129287 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.129193 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 09:38:14.129287 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.129188 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 09:38:14.146538 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.146517 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 09:38:14.155236 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.155219 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 09:38:14.166680 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.166659 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-2fc2c"] Jun 11 09:38:14.169599 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.169543 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74684f8cf7-t4cr5"] Jun 11 09:38:14.170289 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.170271 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb"] Jun 11 09:38:14.216083 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.216052 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4"] Jun 11 09:38:14.218433 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.218417 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l"] Jun 11 09:38:14.218550 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.218534 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.220417 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220398 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj"] Jun 11 09:38:14.220540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220512 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.220828 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a71d589c-fbf5-4a15-a09b-b5288750948a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.220914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220837 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-image-registry-private-configuration\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.220914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47a683a4-0c18-403f-a6ce-be61233e387a-ca-trust-extracted\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.220914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220880 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-bound-sa-token\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.220914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a71d589c-fbf5-4a15-a09b-b5288750948a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.221123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-snapshots\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.221123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-trusted-ca\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.221123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.220998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-installation-pull-secrets\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.221123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74n8\" (UniqueName: \"kubernetes.io/projected/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-kube-api-access-g74n8\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.221123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzpg\" (UniqueName: \"kubernetes.io/projected/a71d589c-fbf5-4a15-a09b-b5288750948a-kube-api-access-hbzpg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221125 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-tmp\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221164 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-trusted-ca-bundle\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-service-ca-bundle\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221230 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-registry-certificates\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221280 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgml8\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-kube-api-access-dgml8\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.221338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.221339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-serving-cert\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.222345 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.222327 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 09:38:14.222466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.222353 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 09:38:14.222466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.222359 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 09:38:14.222466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.222402 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 09:38:14.222466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.222426 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fjcsw\"" Jun 11 09:38:14.222667 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.222563 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" Jun 11 09:38:14.223120 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.223101 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 09:38:14.223229 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.223152 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 09:38:14.224138 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.224112 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8wm4g\"" Jun 11 09:38:14.230199 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.230182 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lpccc\"" Jun 11 09:38:14.237971 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.237950 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l"] Jun 11 09:38:14.239407 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.239300 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4"] Jun 11 09:38:14.240408 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.240288 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj"] Jun 11 09:38:14.265717 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.265690 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd"] Jun 11 09:38:14.268496 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.268474 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.272401 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.272366 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 09:38:14.272871 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.272851 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 09:38:14.272981 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.272869 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 09:38:14.272981 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.272900 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 09:38:14.272981 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.272940 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 09:38:14.273148 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.272995 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 09:38:14.273148 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.273143 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 09:38:14.284796 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.284752 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd"] Jun 11 09:38:14.322434 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322404 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.322580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-trusted-ca-bundle\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.322580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322488 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.322580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322526 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d762f53-eeae-43a5-9b1d-9470a3abbea7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.322580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.322580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-ca\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.322746 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-598m5\" (UniqueName: \"kubernetes.io/projected/7d161574-c5b5-4505-b2d2-0bf56323937e-kube-api-access-598m5\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.322746 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-image-registry-private-configuration\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.322746 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.322705 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 09:38:14.322746 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.322719 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74684f8cf7-t4cr5: secret "image-registry-tls" not found Jun 11 09:38:14.322918 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.322791 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls podName:47a683a4-0c18-403f-a6ce-be61233e387a nodeName:}" failed. No retries permitted until 2026-06-11 09:38:14.822753667 +0000 UTC m=+222.073451222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls") pod "image-registry-74684f8cf7-t4cr5" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a") : secret "image-registry-tls" not found Jun 11 09:38:14.322918 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47a683a4-0c18-403f-a6ce-be61233e387a-ca-trust-extracted\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.322918 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322839 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-bound-sa-token\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.322918 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d161574-c5b5-4505-b2d2-0bf56323937e-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.322918 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a71d589c-fbf5-4a15-a09b-b5288750948a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85ljc\" (UniqueName: \"kubernetes.io/projected/cd74cd07-e117-43c8-8414-934fd561832a-kube-api-access-85ljc\") pod \"network-check-source-dbd9cf844-bm5wj\" (UID: \"cd74cd07-e117-43c8-8414-934fd561832a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322963 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-trusted-ca\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.322991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/152671bc-056d-48aa-af5a-03ab6b2be264-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgdx\" (UniqueName: \"kubernetes.io/projected/8d762f53-eeae-43a5-9b1d-9470a3abbea7-kube-api-access-hsgdx\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzpg\" (UniqueName: \"kubernetes.io/projected/a71d589c-fbf5-4a15-a09b-b5288750948a-kube-api-access-hbzpg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-hub\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.323175 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-tmp\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47a683a4-0c18-403f-a6ce-be61233e387a-ca-trust-extracted\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-registry-certificates\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgml8\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-kube-api-access-dgml8\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-serving-cert\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a71d589c-fbf5-4a15-a09b-b5288750948a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323436 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-trusted-ca-bundle\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323465 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-snapshots\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323492 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.323552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323527 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g74n8\" (UniqueName: \"kubernetes.io/projected/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-kube-api-access-g74n8\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.324021 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323560 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-installation-pull-secrets\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.324021 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323574 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a71d589c-fbf5-4a15-a09b-b5288750948a-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.324021 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-service-ca-bundle\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.324021 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323900 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-registry-certificates\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.324199 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.324073 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-service-ca-bundle\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.324571 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.324537 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-trusted-ca\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.324683 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.324621 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-snapshots\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.325508 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.323534 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-tmp\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.325675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.325654 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-image-registry-private-configuration\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.326162 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.326142 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-serving-cert\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.326440 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.326421 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-installation-pull-secrets\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.326602 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.326588 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a71d589c-fbf5-4a15-a09b-b5288750948a-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.335890 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.335861 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzpg\" (UniqueName: \"kubernetes.io/projected/a71d589c-fbf5-4a15-a09b-b5288750948a-kube-api-access-hbzpg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wr7lb\" (UID: \"a71d589c-fbf5-4a15-a09b-b5288750948a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.338279 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.338254 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-bound-sa-token\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.341956 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.341937 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74n8\" (UniqueName: \"kubernetes.io/projected/70493004-c3b5-4e1d-98a1-e9fc96e6bb5d-kube-api-access-g74n8\") pod \"insights-operator-896549976-2fc2c\" (UID: \"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d\") " pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.344080 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.344057 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgml8\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-kube-api-access-dgml8\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.424779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.424779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.424779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d762f53-eeae-43a5-9b1d-9470a3abbea7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.425011 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424799 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.425011 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-ca\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.425011 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-598m5\" (UniqueName: \"kubernetes.io/projected/7d161574-c5b5-4505-b2d2-0bf56323937e-kube-api-access-598m5\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.425011 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.424892 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 09:38:14.425011 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.424971 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert podName:152671bc-056d-48aa-af5a-03ab6b2be264 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:14.924949468 +0000 UTC m=+222.175647023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rlq5l" (UID: "152671bc-056d-48aa-af5a-03ab6b2be264") : secret "networking-console-plugin-cert" not found Jun 11 09:38:14.425296 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.424901 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d161574-c5b5-4505-b2d2-0bf56323937e-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.425296 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425094 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85ljc\" (UniqueName: \"kubernetes.io/projected/cd74cd07-e117-43c8-8414-934fd561832a-kube-api-access-85ljc\") pod \"network-check-source-dbd9cf844-bm5wj\" (UID: \"cd74cd07-e117-43c8-8414-934fd561832a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" Jun 11 09:38:14.425296 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425136 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/152671bc-056d-48aa-af5a-03ab6b2be264-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.425296 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgdx\" (UniqueName: \"kubernetes.io/projected/8d762f53-eeae-43a5-9b1d-9470a3abbea7-kube-api-access-hsgdx\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.425296 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425191 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.425296 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-hub\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.425655 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425617 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d161574-c5b5-4505-b2d2-0bf56323937e-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.425739 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.425684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d762f53-eeae-43a5-9b1d-9470a3abbea7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.425914 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.425812 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:14.425914 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.425882 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls podName:7d161574-c5b5-4505-b2d2-0bf56323937e nodeName:}" failed. No retries permitted until 2026-06-11 09:38:14.925864445 +0000 UTC m=+222.176562022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-k7gd4" (UID: "7d161574-c5b5-4505-b2d2-0bf56323937e") : secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:14.426066 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.426044 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/152671bc-056d-48aa-af5a-03ab6b2be264-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.427464 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.427432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.427547 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.427523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-ca\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.427740 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.427723 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.427797 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.427735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8d762f53-eeae-43a5-9b1d-9470a3abbea7-hub\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.430540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.430527 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" Jun 11 09:38:14.435551 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.435538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-2fc2c" Jun 11 09:38:14.437812 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.437791 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85ljc\" (UniqueName: \"kubernetes.io/projected/cd74cd07-e117-43c8-8414-934fd561832a-kube-api-access-85ljc\") pod \"network-check-source-dbd9cf844-bm5wj\" (UID: \"cd74cd07-e117-43c8-8414-934fd561832a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" Jun 11 09:38:14.437954 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.437936 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgdx\" (UniqueName: \"kubernetes.io/projected/8d762f53-eeae-43a5-9b1d-9470a3abbea7-kube-api-access-hsgdx\") pod \"cluster-proxy-proxy-agent-64d8b9fffc-fd5hd\" (UID: \"8d762f53-eeae-43a5-9b1d-9470a3abbea7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.438038 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.438015 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-598m5\" (UniqueName: \"kubernetes.io/projected/7d161574-c5b5-4505-b2d2-0bf56323937e-kube-api-access-598m5\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.511609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.511573 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:14.542311 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.542280 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" Jun 11 09:38:14.577258 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.577202 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb"] Jun 11 09:38:14.579383 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:14.579354 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71d589c_fbf5_4a15_a09b_b5288750948a.slice/crio-3d3f8d5d41083b15eed94e8cb3005b47c8d8623f4f34c5867e0dcd694fae69be WatchSource:0}: Error finding container 3d3f8d5d41083b15eed94e8cb3005b47c8d8623f4f34c5867e0dcd694fae69be: Status 404 returned error can't find the container with id 3d3f8d5d41083b15eed94e8cb3005b47c8d8623f4f34c5867e0dcd694fae69be Jun 11 09:38:14.585157 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.584993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:38:14.585835 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.585810 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-2fc2c"] Jun 11 09:38:14.588697 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:14.588671 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70493004_c3b5_4e1d_98a1_e9fc96e6bb5d.slice/crio-bd7fc5058b9230ad1732ace1960bc19f28be21bbd8fbf998d3682a3cf74a1909 WatchSource:0}: Error finding container bd7fc5058b9230ad1732ace1960bc19f28be21bbd8fbf998d3682a3cf74a1909: Status 404 returned error can't find the container with id bd7fc5058b9230ad1732ace1960bc19f28be21bbd8fbf998d3682a3cf74a1909 Jun 11 09:38:14.612075 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.612042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:14.680627 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.680470 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj"] Jun 11 09:38:14.683318 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:14.683283 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd74cd07_e117_43c8_8414_934fd561832a.slice/crio-fe7cd75b9100488ea0de6429a4de130e65c2616b8de4fd84f4b7440b21c79a3e WatchSource:0}: Error finding container fe7cd75b9100488ea0de6429a4de130e65c2616b8de4fd84f4b7440b21c79a3e: Status 404 returned error can't find the container with id fe7cd75b9100488ea0de6429a4de130e65c2616b8de4fd84f4b7440b21c79a3e Jun 11 09:38:14.725847 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.725819 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd"] Jun 11 09:38:14.728628 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:14.728606 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d762f53_eeae_43a5_9b1d_9470a3abbea7.slice/crio-09169a4ecf115529a86545c110d82e720c2dc9f827c01a1a901b67e9929e4dc7 WatchSource:0}: Error finding container 09169a4ecf115529a86545c110d82e720c2dc9f827c01a1a901b67e9929e4dc7: Status 404 returned error can't find the container with id 09169a4ecf115529a86545c110d82e720c2dc9f827c01a1a901b67e9929e4dc7 Jun 11 09:38:14.829260 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.829228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:14.829438 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.829362 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 09:38:14.829438 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.829376 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74684f8cf7-t4cr5: secret "image-registry-tls" not found Jun 11 09:38:14.829438 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.829426 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls podName:47a683a4-0c18-403f-a6ce-be61233e387a nodeName:}" failed. No retries permitted until 2026-06-11 09:38:15.829411638 +0000 UTC m=+223.080109198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls") pod "image-registry-74684f8cf7-t4cr5" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a") : secret "image-registry-tls" not found Jun 11 09:38:14.930417 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.930386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:14.930632 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.930454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:14.930632 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.930539 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:14.930632 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.930610 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls podName:7d161574-c5b5-4505-b2d2-0bf56323937e nodeName:}" failed. No retries permitted until 2026-06-11 09:38:15.930593749 +0000 UTC m=+223.181291304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-k7gd4" (UID: "7d161574-c5b5-4505-b2d2-0bf56323937e") : secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:14.930632 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.930546 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 09:38:14.930887 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:14.930658 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert podName:152671bc-056d-48aa-af5a-03ab6b2be264 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:15.930648924 +0000 UTC m=+223.181346480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rlq5l" (UID: "152671bc-056d-48aa-af5a-03ab6b2be264") : secret "networking-console-plugin-cert" not found Jun 11 09:38:14.943154 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.943125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2fc2c" event={"ID":"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d","Type":"ContainerStarted","Data":"bd7fc5058b9230ad1732ace1960bc19f28be21bbd8fbf998d3682a3cf74a1909"} Jun 11 09:38:14.944169 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.944148 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" event={"ID":"a71d589c-fbf5-4a15-a09b-b5288750948a","Type":"ContainerStarted","Data":"3d3f8d5d41083b15eed94e8cb3005b47c8d8623f4f34c5867e0dcd694fae69be"} Jun 11 09:38:14.945606 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.945588 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" event={"ID":"cd74cd07-e117-43c8-8414-934fd561832a","Type":"ContainerStarted","Data":"6e9683d1c4eaa0d87a09acb1536e455c13e688eb386d492df447590eb120fa5d"} Jun 11 09:38:14.945709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.945623 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" event={"ID":"cd74cd07-e117-43c8-8414-934fd561832a","Type":"ContainerStarted","Data":"fe7cd75b9100488ea0de6429a4de130e65c2616b8de4fd84f4b7440b21c79a3e"} Jun 11 09:38:14.946638 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:14.946614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" event={"ID":"8d762f53-eeae-43a5-9b1d-9470a3abbea7","Type":"ContainerStarted","Data":"09169a4ecf115529a86545c110d82e720c2dc9f827c01a1a901b67e9929e4dc7"} Jun 11 09:38:15.843904 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:15.843225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:15.843904 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.843423 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 09:38:15.843904 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.843439 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74684f8cf7-t4cr5: secret "image-registry-tls" not found Jun 11 09:38:15.843904 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.843495 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls podName:47a683a4-0c18-403f-a6ce-be61233e387a nodeName:}" failed. No retries permitted until 2026-06-11 09:38:17.843477136 +0000 UTC m=+225.094174694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls") pod "image-registry-74684f8cf7-t4cr5" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a") : secret "image-registry-tls" not found Jun 11 09:38:15.944535 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:15.944477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:15.944704 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:15.944618 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:15.945025 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.944838 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 09:38:15.945025 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.944885 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:15.945025 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.944902 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert podName:152671bc-056d-48aa-af5a-03ab6b2be264 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:17.944884139 +0000 UTC m=+225.195581697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rlq5l" (UID: "152671bc-056d-48aa-af5a-03ab6b2be264") : secret "networking-console-plugin-cert" not found Jun 11 09:38:15.945025 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:15.944952 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls podName:7d161574-c5b5-4505-b2d2-0bf56323937e nodeName:}" failed. No retries permitted until 2026-06-11 09:38:17.944934804 +0000 UTC m=+225.195632366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-k7gd4" (UID: "7d161574-c5b5-4505-b2d2-0bf56323937e") : secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:16.133291 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:16.133184 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:16.215553 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:16.215472 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:17.860646 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:17.860602 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:17.861057 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.860796 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 09:38:17.861057 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.860821 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74684f8cf7-t4cr5: secret "image-registry-tls" not found Jun 11 09:38:17.861057 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.860891 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls podName:47a683a4-0c18-403f-a6ce-be61233e387a nodeName:}" failed. No retries permitted until 2026-06-11 09:38:21.860869635 +0000 UTC m=+229.111567195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls") pod "image-registry-74684f8cf7-t4cr5" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a") : secret "image-registry-tls" not found Jun 11 09:38:17.961062 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:17.961030 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:17.961255 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:17.961101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:17.961255 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.961202 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 09:38:17.961372 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.961278 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert podName:152671bc-056d-48aa-af5a-03ab6b2be264 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:21.961258524 +0000 UTC m=+229.211956095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rlq5l" (UID: "152671bc-056d-48aa-af5a-03ab6b2be264") : secret "networking-console-plugin-cert" not found Jun 11 09:38:17.961372 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.961204 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:17.961476 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:17.961380 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls podName:7d161574-c5b5-4505-b2d2-0bf56323937e nodeName:}" failed. No retries permitted until 2026-06-11 09:38:21.961359612 +0000 UTC m=+229.212057174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-k7gd4" (UID: "7d161574-c5b5-4505-b2d2-0bf56323937e") : secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:19.944242 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.944195 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:19.963265 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.963236 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" event={"ID":"8d762f53-eeae-43a5-9b1d-9470a3abbea7","Type":"ContainerStarted","Data":"bd33087935709dcca0cf91e3d93c5aa740e9d3339ce12fdbc58f97aea68cfc8c"} Jun 11 09:38:19.963404 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.963285 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" event={"ID":"8d762f53-eeae-43a5-9b1d-9470a3abbea7","Type":"ContainerStarted","Data":"451378c92470ac0dfc372883cb9bcfc22885b95c26aac806b94683f7531bff6e"} Jun 11 09:38:19.963404 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.963306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" event={"ID":"8d762f53-eeae-43a5-9b1d-9470a3abbea7","Type":"ContainerStarted","Data":"a1d21b40233656654e1c0a0424c4905ed3ee6b348559a84b84ad8c5239381556"} Jun 11 09:38:19.964744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.964718 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2fc2c" event={"ID":"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d","Type":"ContainerStarted","Data":"77f0c82fdb824fc81c4fd87df9672cb6a0d2383b870cea2790e4024c85bc1067"} Jun 11 09:38:19.966255 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.966234 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" event={"ID":"a71d589c-fbf5-4a15-a09b-b5288750948a","Type":"ContainerStarted","Data":"c355a3d4024002c154891c43351e580ffa998173b44d70cbdf079649f21a5ace"} Jun 11 09:38:19.990152 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.990103 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" podStartSLOduration=1.313064721 podStartE2EDuration="5.990090725s" totalImagesPullingTime="4.677026004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:19.989108478 +0000 UTC m=+227.239806056" watchObservedRunningTime="2026-06-11 09:38:19.990090725 +0000 UTC m=+227.240788302" Jun 11 09:38:19.991005 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:19.990955 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bm5wj" podStartSLOduration=5.990942721 podStartE2EDuration="5.990942721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:14.977486814 +0000 UTC m=+222.228184392" watchObservedRunningTime="2026-06-11 09:38:19.990942721 +0000 UTC m=+227.241640300" Jun 11 09:38:20.014744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:20.014700 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" podStartSLOduration=1.245102945 podStartE2EDuration="6.014685766s" totalImagesPullingTime="4.769582821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:20.013194671 +0000 UTC m=+227.263892250" watchObservedRunningTime="2026-06-11 09:38:20.014685766 +0000 UTC m=+227.265383346" Jun 11 09:38:20.068246 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:20.068207 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:20.290130 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:20.290041 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:20.397088 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:20.397056 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:20.571477 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:20.571397 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:20.683977 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:20.683944 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:21.155010 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:21.154978 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:21.407152 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:21.407062 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:21.558289 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:21.558254 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:21.892212 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:21.892175 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:21.892365 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.892324 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 09:38:21.892365 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.892341 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74684f8cf7-t4cr5: secret "image-registry-tls" not found Jun 11 09:38:21.892451 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.892397 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls podName:47a683a4-0c18-403f-a6ce-be61233e387a nodeName:}" failed. No retries permitted until 2026-06-11 09:38:29.892381399 +0000 UTC m=+237.143078956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls") pod "image-registry-74684f8cf7-t4cr5" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a") : secret "image-registry-tls" not found Jun 11 09:38:21.993191 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:21.993157 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:21.993348 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:21.993233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:21.993348 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.993307 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:21.993348 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.993336 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 09:38:21.993469 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.993370 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls podName:7d161574-c5b5-4505-b2d2-0bf56323937e nodeName:}" failed. No retries permitted until 2026-06-11 09:38:29.99335465 +0000 UTC m=+237.244052210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-k7gd4" (UID: "7d161574-c5b5-4505-b2d2-0bf56323937e") : secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:21.993469 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:21.993385 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert podName:152671bc-056d-48aa-af5a-03ab6b2be264 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:29.993378791 +0000 UTC m=+237.244076347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rlq5l" (UID: "152671bc-056d-48aa-af5a-03ab6b2be264") : secret "networking-console-plugin-cert" not found Jun 11 09:38:22.485908 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:22.485874 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:22.614626 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:22.614595 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:22.904061 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:22.904035 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2dfw_c65cf062-90d4-41de-a2e1-6be061576475/dns-node-resolver/0.log" Jun 11 09:38:23.659702 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:23.659672 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:23.904140 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:23.904116 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5dhcg_8d87c275-3b60-46a1-ae16-8b8a83a371bc/node-ca/0.log" Jun 11 09:38:24.163778 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:24.163732 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:24.399972 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:24.399936 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:24.492420 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:24.492338 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:24.573176 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:24.573147 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:24.672727 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:24.672697 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:24.881660 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:24.881628 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:25.106673 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:25.106643 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjrrn_6f71ddba-ddd0-4c68-8627-c16833b90bb1/serve-healthcheck-canary/0.log" Jun 11 09:38:25.679651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:25.679616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:26.052227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:26.052148 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:26.435775 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:26.435739 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:26.628436 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:26.628404 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:27.032361 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:27.032325 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:27.433402 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:27.433370 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:28.042584 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:28.042550 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:28.136225 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:28.136197 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:28.440928 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:28.440895 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:28.847347 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:28.847319 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:28.931780 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:28.931729 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:29.263967 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:29.263884 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:29.737159 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:29.737127 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:29.919233 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:29.919202 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:29.960456 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:29.960425 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:29.962800 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:29.962783 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"image-registry-74684f8cf7-t4cr5\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:30.040325 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.040241 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:30.061609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.061566 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:30.061732 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.061633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:30.061732 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:30.061714 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 09:38:30.061862 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:30.061751 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:30.061862 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:30.061810 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert podName:152671bc-056d-48aa-af5a-03ab6b2be264 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:46.0617882 +0000 UTC m=+253.312485773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-rlq5l" (UID: "152671bc-056d-48aa-af5a-03ab6b2be264") : secret "networking-console-plugin-cert" not found Jun 11 09:38:30.061862 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:30.061837 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls podName:7d161574-c5b5-4505-b2d2-0bf56323937e nodeName:}" failed. No retries permitted until 2026-06-11 09:38:46.061824822 +0000 UTC m=+253.312522383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-k7gd4" (UID: "7d161574-c5b5-4505-b2d2-0bf56323937e") : secret "cluster-monitoring-operator-tls" not found Jun 11 09:38:30.130056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.130026 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:30.198882 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.198831 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-2fc2c" podStartSLOduration=11.441714415 podStartE2EDuration="16.198808078s" totalImagesPullingTime="4.757093663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:20.044753671 +0000 UTC m=+227.295451250" watchObservedRunningTime="2026-06-11 09:38:30.198808078 +0000 UTC m=+237.449505656" Jun 11 09:38:30.199201 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.199183 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74684f8cf7-t4cr5"] Jun 11 09:38:30.201329 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:30.201298 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a683a4_0c18_403f_a6ce_be61233e387a.slice/crio-982f3d09451971c16cf30e152d02318b5ad769788fcba8a71032e408044c0bdc WatchSource:0}: Error finding container 982f3d09451971c16cf30e152d02318b5ad769788fcba8a71032e408044c0bdc: Status 404 returned error can't find the container with id 982f3d09451971c16cf30e152d02318b5ad769788fcba8a71032e408044c0bdc Jun 11 09:38:30.493957 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.493915 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:30.656118 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.656086 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:30.916146 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:30.916113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:31.004447 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:31.004412 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" event={"ID":"47a683a4-0c18-403f-a6ce-be61233e387a","Type":"ContainerStarted","Data":"ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a"} Jun 11 09:38:31.004643 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:31.004467 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" event={"ID":"47a683a4-0c18-403f-a6ce-be61233e387a","Type":"ContainerStarted","Data":"982f3d09451971c16cf30e152d02318b5ad769788fcba8a71032e408044c0bdc"} Jun 11 09:38:31.004643 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:31.004534 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:38:31.326105 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:31.326032 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:31.661147 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:31.661113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:31.897851 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:31.897786 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:32.462447 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:32.462415 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:32.638734 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:32.638702 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:33.262118 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:33.262085 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:33.404836 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:33.404802 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:33.538306 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:33.538226 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:33.879642 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:33.879611 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:34.469744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:34.469713 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:34.642325 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:34.642298 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:34.834559 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:34.834477 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:41.754935 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:41.754900 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:41.912499 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:41.912461 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:43.840181 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.840120 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" podStartSLOduration=29.840105016 podStartE2EDuration="29.840105016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:31.074528673 +0000 UTC m=+238.325226252" watchObservedRunningTime="2026-06-11 09:38:43.840105016 +0000 UTC m=+251.090802603" Jun 11 09:38:43.840924 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.840904 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74684f8cf7-t4cr5"] Jun 11 09:38:43.884550 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.884523 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6fbdt"] Jun 11 09:38:43.889541 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.889523 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:43.899710 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.899688 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xdzqm\"" Jun 11 09:38:43.899861 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.899712 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 09:38:43.900041 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.900026 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 09:38:43.909372 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.909348 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6fbdt"] Jun 11 09:38:43.970728 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.970699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b71a94-7494-4f88-afc1-d50bf47cfc1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:43.970905 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.970734 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44b71a94-7494-4f88-afc1-d50bf47cfc1b-data-volume\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:43.970905 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.970752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7sqh\" (UniqueName: \"kubernetes.io/projected/44b71a94-7494-4f88-afc1-d50bf47cfc1b-kube-api-access-p7sqh\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:43.970905 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.970874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44b71a94-7494-4f88-afc1-d50bf47cfc1b-crio-socket\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:43.970905 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:43.970896 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b71a94-7494-4f88-afc1-d50bf47cfc1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071247 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071218 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b71a94-7494-4f88-afc1-d50bf47cfc1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071413 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44b71a94-7494-4f88-afc1-d50bf47cfc1b-data-volume\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071413 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071273 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7sqh\" (UniqueName: \"kubernetes.io/projected/44b71a94-7494-4f88-afc1-d50bf47cfc1b-kube-api-access-p7sqh\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071413 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:38:44.071413 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071340 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44b71a94-7494-4f88-afc1-d50bf47cfc1b-crio-socket\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071413 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071360 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b71a94-7494-4f88-afc1-d50bf47cfc1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071677 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071495 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/44b71a94-7494-4f88-afc1-d50bf47cfc1b-crio-socket\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.071677 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071648 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/44b71a94-7494-4f88-afc1-d50bf47cfc1b-data-volume\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.072000 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.071982 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/44b71a94-7494-4f88-afc1-d50bf47cfc1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.073609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.073588 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/44b71a94-7494-4f88-afc1-d50bf47cfc1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.073696 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.073599 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4f19fec-d824-439a-9722-e2af866a4010-metrics-certs\") pod \"network-metrics-daemon-lcnlh\" (UID: \"b4f19fec-d824-439a-9722-e2af866a4010\") " pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:38:44.085473 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.085444 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7sqh\" (UniqueName: \"kubernetes.io/projected/44b71a94-7494-4f88-afc1-d50bf47cfc1b-kube-api-access-p7sqh\") pod \"insights-runtime-extractor-6fbdt\" (UID: \"44b71a94-7494-4f88-afc1-d50bf47cfc1b\") " pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.092991 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.092931 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:44.175653 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.175623 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fdlt8\"" Jun 11 09:38:44.183469 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.183450 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lcnlh" Jun 11 09:38:44.198479 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.198454 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6fbdt" Jun 11 09:38:44.267803 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.267693 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:44.356302 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.356279 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6fbdt"] Jun 11 09:38:44.358636 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:44.358611 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b71a94_7494_4f88_afc1_d50bf47cfc1b.slice/crio-663e38c562851dea9fa78e7dddb958be54b5366ddfb2265e5b929d717df1101c WatchSource:0}: Error finding container 663e38c562851dea9fa78e7dddb958be54b5366ddfb2265e5b929d717df1101c: Status 404 returned error can't find the container with id 663e38c562851dea9fa78e7dddb958be54b5366ddfb2265e5b929d717df1101c Jun 11 09:38:44.359173 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:44.359148 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f19fec_d824_439a_9722_e2af866a4010.slice/crio-3f3f0947117be6133767851f9cca82b5faf9947266259dd59e3f927d44dd978f WatchSource:0}: Error finding container 3f3f0947117be6133767851f9cca82b5faf9947266259dd59e3f927d44dd978f: Status 404 returned error can't find the container with id 3f3f0947117be6133767851f9cca82b5faf9947266259dd59e3f927d44dd978f Jun 11 09:38:44.361103 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:44.361082 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lcnlh"] Jun 11 09:38:45.047381 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:45.047339 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdt" event={"ID":"44b71a94-7494-4f88-afc1-d50bf47cfc1b","Type":"ContainerStarted","Data":"cbc9bee1c432a05dba41ae57fa43d6c8b9af8afb3bca0a5835cbf5a324106207"} Jun 11 09:38:45.047869 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:45.047418 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdt" event={"ID":"44b71a94-7494-4f88-afc1-d50bf47cfc1b","Type":"ContainerStarted","Data":"663e38c562851dea9fa78e7dddb958be54b5366ddfb2265e5b929d717df1101c"} Jun 11 09:38:45.048493 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:45.048460 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lcnlh" event={"ID":"b4f19fec-d824-439a-9722-e2af866a4010","Type":"ContainerStarted","Data":"3f3f0947117be6133767851f9cca82b5faf9947266259dd59e3f927d44dd978f"} Jun 11 09:38:45.811077 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:45.811018 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:45.913659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:45.913623 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:46.054261 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.054225 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdt" event={"ID":"44b71a94-7494-4f88-afc1-d50bf47cfc1b","Type":"ContainerStarted","Data":"0ce31bfcb6400c8ff300265b71cef5f617272ee983e05591457b6a5e234af841"} Jun 11 09:38:46.056091 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.056057 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lcnlh" event={"ID":"b4f19fec-d824-439a-9722-e2af866a4010","Type":"ContainerStarted","Data":"7a31e9395987696f7b3c47de4f49399560cdceda0b36a066ce679a4e9e90daea"} Jun 11 09:38:46.056229 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.056110 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lcnlh" event={"ID":"b4f19fec-d824-439a-9722-e2af866a4010","Type":"ContainerStarted","Data":"4da13d9b7da57c4b4f596913d8e6d46a0de3a54d5ab873bbb9d121fd7b1fb991"} Jun 11 09:38:46.088890 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.088855 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:46.089062 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.088942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:46.090656 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.090597 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lcnlh" podStartSLOduration=252.218645501 podStartE2EDuration="4m13.090579856s" totalImagesPullingTime="871.934355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:46.089002744 +0000 UTC m=+253.339700323" watchObservedRunningTime="2026-06-11 09:38:46.090579856 +0000 UTC m=+253.341277437" Jun 11 09:38:46.092045 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.092018 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/152671bc-056d-48aa-af5a-03ab6b2be264-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-rlq5l\" (UID: \"152671bc-056d-48aa-af5a-03ab6b2be264\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:46.092127 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.092037 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d161574-c5b5-4505-b2d2-0bf56323937e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-k7gd4\" (UID: \"7d161574-c5b5-4505-b2d2-0bf56323937e\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:46.120256 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.120223 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:46.332886 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.332853 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fjcsw\"" Jun 11 09:38:46.337955 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.337927 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8wm4g\"" Jun 11 09:38:46.340064 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.340008 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" Jun 11 09:38:46.344961 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.344939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" Jun 11 09:38:46.345729 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.345706 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:46.506969 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.506942 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:46.679948 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.679924 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4"] Jun 11 09:38:46.680968 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:46.680946 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d161574_c5b5_4505_b2d2_0bf56323937e.slice/crio-7c98e743d2f0c958f9b74927484d379328412b21428f57e8e0e6bf2e6125620c WatchSource:0}: Error finding container 7c98e743d2f0c958f9b74927484d379328412b21428f57e8e0e6bf2e6125620c: Status 404 returned error can't find the container with id 7c98e743d2f0c958f9b74927484d379328412b21428f57e8e0e6bf2e6125620c Jun 11 09:38:46.700996 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.700973 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l"] Jun 11 09:38:46.703773 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:46.703741 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152671bc_056d_48aa_af5a_03ab6b2be264.slice/crio-3a512868f7d39cc5bd34a5bc5a5302d11af7026b847d01c24eb014f9d10d5b3d WatchSource:0}: Error finding container 3a512868f7d39cc5bd34a5bc5a5302d11af7026b847d01c24eb014f9d10d5b3d: Status 404 returned error can't find the container with id 3a512868f7d39cc5bd34a5bc5a5302d11af7026b847d01c24eb014f9d10d5b3d Jun 11 09:38:46.807505 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:46.807467 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:47.066672 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:47.066579 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6fbdt" event={"ID":"44b71a94-7494-4f88-afc1-d50bf47cfc1b","Type":"ContainerStarted","Data":"78bf223cbba97f3312f26f07a1dafef85b2a52b46d6a741bf4690b273d58ed2c"} Jun 11 09:38:47.067725 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:47.067701 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" event={"ID":"152671bc-056d-48aa-af5a-03ab6b2be264","Type":"ContainerStarted","Data":"3a512868f7d39cc5bd34a5bc5a5302d11af7026b847d01c24eb014f9d10d5b3d"} Jun 11 09:38:47.068675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:47.068651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" event={"ID":"7d161574-c5b5-4505-b2d2-0bf56323937e","Type":"ContainerStarted","Data":"7c98e743d2f0c958f9b74927484d379328412b21428f57e8e0e6bf2e6125620c"} Jun 11 09:38:47.102725 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:47.102678 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6fbdt" podStartSLOduration=2.012645969 podStartE2EDuration="4.102663898s" totalImagesPullingTime="2.090017929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 09:38:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:47.102226207 +0000 UTC m=+254.352923784" watchObservedRunningTime="2026-06-11 09:38:47.102663898 +0000 UTC m=+254.353361475" Jun 11 09:38:48.074417 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:48.074359 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" event={"ID":"152671bc-056d-48aa-af5a-03ab6b2be264","Type":"ContainerStarted","Data":"1df2d354fdd7d88cc7b266eed2c0ac39b8e9890efdf4da83a9cfb3e019a8f628"} Jun 11 09:38:48.101685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:48.101380 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-rlq5l" podStartSLOduration=32.872839396 podStartE2EDuration="34.101362653s" totalImagesPullingTime="1.228523257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:48.100919104 +0000 UTC m=+255.351616682" watchObservedRunningTime="2026-06-11 09:38:48.101362653 +0000 UTC m=+255.352060326" Jun 11 09:38:48.279742 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:48.279654 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:48.397196 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:48.397154 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:49.008837 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.008803 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:49.079749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.079718 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" event={"ID":"7d161574-c5b5-4505-b2d2-0bf56323937e","Type":"ContainerStarted","Data":"958b548842bd38dd4e580ce0ba23b589f24be2553ee4161baeb4bc49771fcdab"} Jun 11 09:38:49.108682 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.108633 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-k7gd4" podStartSLOduration=33.276388334 podStartE2EDuration="35.108616041s" totalImagesPullingTime="1.832227707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:38:49.107400157 +0000 UTC m=+256.358097736" watchObservedRunningTime="2026-06-11 09:38:49.108616041 +0000 UTC m=+256.359313619" Jun 11 09:38:49.204274 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.204236 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:49.357509 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.357474 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:49.582211 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.582184 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:49.752339 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:49.752259 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:52.277890 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:52.277856 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:52.364260 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:52.364223 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:52.628799 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:52.628747 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:53.846911 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:53.846876 2557 patch_prober.go:28] interesting pod/image-registry-74684f8cf7-t4cr5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 09:38:53.847266 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:53.846927 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 09:38:54.935409 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:54.935374 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:56.570038 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:56.570002 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:56.831446 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:56.831360 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.070497 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.070463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.209206 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.209169 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rbjnp"] Jun 11 09:38:57.213682 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.213654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.218378 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:57.218353 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jun 11 09:38:57.218627 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:57.218607 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" Jun 11 09:38:57.218932 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:57.218908 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-rbjnp\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" podUID="371e910d-ee33-468e-841c-8e186880f136" pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.219012 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:57.218953 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jun 11 09:38:57.219203 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:57.219179 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Jun 11 09:38:57.219203 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:57.219178 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-4qs24\" is forbidden: User \"system:node:ip-10-0-137-96.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-137-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qs24\"" type="*v1.Secret" Jun 11 09:38:57.326695 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.326664 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.380933 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.380891 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371e910d-ee33-468e-841c-8e186880f136-node-exporter-textfile\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.380933 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.380939 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381190 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.380957 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-sys\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381190 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.381032 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw6tn\" (UniqueName: \"kubernetes.io/projected/371e910d-ee33-468e-841c-8e186880f136-kube-api-access-lw6tn\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381190 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.381103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371e910d-ee33-468e-841c-8e186880f136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381190 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.381133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371e910d-ee33-468e-841c-8e186880f136-node-exporter-tls\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381190 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.381157 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-node-exporter-wtmp\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381372 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.381233 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-metrics-client-ca\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.381372 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.381256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-root\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.425152 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.425118 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.482338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371e910d-ee33-468e-841c-8e186880f136-node-exporter-tls\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-node-exporter-wtmp\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482338 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-metrics-client-ca\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-root\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482405 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-root\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371e910d-ee33-468e-841c-8e186880f136-node-exporter-textfile\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482459 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-node-exporter-wtmp\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482488 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482540 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482509 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-sys\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482719 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482555 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371e910d-ee33-468e-841c-8e186880f136-sys\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482719 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw6tn\" (UniqueName: \"kubernetes.io/projected/371e910d-ee33-468e-841c-8e186880f136-kube-api-access-lw6tn\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482719 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482636 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371e910d-ee33-468e-841c-8e186880f136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.482834 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.482750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/371e910d-ee33-468e-841c-8e186880f136-node-exporter-textfile\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.492375 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.492348 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw6tn\" (UniqueName: \"kubernetes.io/projected/371e910d-ee33-468e-841c-8e186880f136-kube-api-access-lw6tn\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:57.524836 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.524811 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.784940 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.784858 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.884609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.884576 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:57.999814 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:57.999775 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:58.115252 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.115225 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 09:38:58.125491 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.125460 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371e910d-ee33-468e-841c-8e186880f136-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:58.220028 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.219999 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 09:38:58.225178 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.225153 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/371e910d-ee33-468e-841c-8e186880f136-node-exporter-tls\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:58.302370 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.302341 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:58.403473 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.403392 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 09:38:58.413128 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.413100 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-node-exporter-accelerators-collector-config\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:58.482922 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:58.482895 2557 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Jun 11 09:38:58.483074 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:38:58.482994 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-metrics-client-ca podName:371e910d-ee33-468e-841c-8e186880f136 nodeName:}" failed. No retries permitted until 2026-06-11 09:38:58.982977127 +0000 UTC m=+266.233674684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-metrics-client-ca") pod "node-exporter-rbjnp" (UID: "371e910d-ee33-468e-841c-8e186880f136") : failed to sync configmap cache: timed out waiting for the condition Jun 11 09:38:58.561638 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.561606 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qs24\"" Jun 11 09:38:58.773352 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.773270 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 09:38:58.996313 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.996280 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-metrics-client-ca\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:58.996855 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:58.996835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371e910d-ee33-468e-841c-8e186880f136-metrics-client-ca\") pod \"node-exporter-rbjnp\" (UID: \"371e910d-ee33-468e-841c-8e186880f136\") " pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:59.022427 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.022390 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rbjnp" Jun 11 09:38:59.035350 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:38:59.035323 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371e910d_ee33_468e_841c_8e186880f136.slice/crio-09784d89e25bbf40b35b8914a9c4a98dfb75e8d4831a5a4b3069926bab01f14b WatchSource:0}: Error finding container 09784d89e25bbf40b35b8914a9c4a98dfb75e8d4831a5a4b3069926bab01f14b: Status 404 returned error can't find the container with id 09784d89e25bbf40b35b8914a9c4a98dfb75e8d4831a5a4b3069926bab01f14b Jun 11 09:38:59.114032 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.114000 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbjnp" event={"ID":"371e910d-ee33-468e-841c-8e186880f136","Type":"ContainerStarted","Data":"09784d89e25bbf40b35b8914a9c4a98dfb75e8d4831a5a4b3069926bab01f14b"} Jun 11 09:38:59.123100 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.123077 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:59.224342 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.224316 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:59.564412 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.564365 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:59.720278 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.720249 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:59.820861 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.820778 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:59.913384 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.913355 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:38:59.924313 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.924285 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75bc84d886-q5jk9"] Jun 11 09:38:59.927964 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.927943 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:38:59.934823 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.934516 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 09:38:59.934823 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.934719 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 09:38:59.935659 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.935639 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 09:38:59.936373 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.936357 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c3dl1t4uf49cd\"" Jun 11 09:38:59.937371 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.937357 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pvrqc\"" Jun 11 09:38:59.937673 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.937654 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 09:38:59.937787 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.937699 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 09:38:59.959346 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:38:59.959313 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75bc84d886-q5jk9"] Jun 11 09:39:00.105243 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105259 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-metrics-client-ca\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-grpc-tls\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c64jb\" (UniqueName: \"kubernetes.io/projected/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-kube-api-access-c64jb\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105377 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105446 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-tls\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.105649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.105472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.119002 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.118973 2557 generic.go:356] "Generic (PLEG): container finished" podID="371e910d-ee33-468e-841c-8e186880f136" containerID="8ff1059b5af400b898f524dac476a1070d6de71a37f2b9fc06aaf4952a81f344" exitCode=0 Jun 11 09:39:00.119119 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.119039 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbjnp" event={"ID":"371e910d-ee33-468e-841c-8e186880f136","Type":"ContainerDied","Data":"8ff1059b5af400b898f524dac476a1070d6de71a37f2b9fc06aaf4952a81f344"} Jun 11 09:39:00.135680 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.135656 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:00.206449 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206425 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206553 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206553 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-metrics-client-ca\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206553 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206515 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-grpc-tls\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206553 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c64jb\" (UniqueName: \"kubernetes.io/projected/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-kube-api-access-c64jb\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206554 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.206744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.206626 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-tls\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.207388 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.207365 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-metrics-client-ca\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.209530 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.209505 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.209642 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.209570 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.209642 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.209627 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-grpc-tls\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.209894 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.209838 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.209894 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.209859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.210409 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.210391 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-secret-thanos-querier-tls\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.232665 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.232634 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c64jb\" (UniqueName: \"kubernetes.io/projected/f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf-kube-api-access-c64jb\") pod \"thanos-querier-75bc84d886-q5jk9\" (UID: \"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf\") " pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.237472 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.237447 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:00.349887 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.349743 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:00.386998 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.386967 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75bc84d886-q5jk9"] Jun 11 09:39:00.389325 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:39:00.389292 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42aa9a0_e0ef_4cb0_a3c1_bee429e493bf.slice/crio-8ee95e0818e9d433c65ab87ffc101d738555031e0182a046c3bf866ae8155a87 WatchSource:0}: Error finding container 8ee95e0818e9d433c65ab87ffc101d738555031e0182a046c3bf866ae8155a87: Status 404 returned error can't find the container with id 8ee95e0818e9d433c65ab87ffc101d738555031e0182a046c3bf866ae8155a87 Jun 11 09:39:00.594300 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.594261 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:00.697888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.697811 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:00.795236 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.795193 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:00.937496 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:00.937454 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:01.124649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.124607 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"8ee95e0818e9d433c65ab87ffc101d738555031e0182a046c3bf866ae8155a87"} Jun 11 09:39:01.127121 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.127091 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbjnp" event={"ID":"371e910d-ee33-468e-841c-8e186880f136","Type":"ContainerStarted","Data":"26e5ae191a84af765790baa4b06ce9e674fe78d9555b3e6467c5de0f4ff75781"} Jun 11 09:39:01.127260 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.127145 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rbjnp" event={"ID":"371e910d-ee33-468e-841c-8e186880f136","Type":"ContainerStarted","Data":"4bc970f515e6a56b21816955fd738af4edfc95e083869343720f985d8951b2a7"} Jun 11 09:39:01.152366 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.152307 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rbjnp" podStartSLOduration=3.155905742 podStartE2EDuration="4.152292789s" totalImagesPullingTime="930.751896ms" totalInitContainerRuntime="65.635151ms" isStatefulPod=true podCreationTimestamp="2026-06-11 09:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:01.151707683 +0000 UTC m=+268.402405261" watchObservedRunningTime="2026-06-11 09:39:01.152292789 +0000 UTC m=+268.402990368" Jun 11 09:39:01.598323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.598290 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-t784m"] Jun 11 09:39:01.599216 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.599187 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:01.601809 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.601791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.604981 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.604961 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 09:39:01.605248 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.605221 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-b4n7m\"" Jun 11 09:39:01.615097 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.615073 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-t784m"] Jun 11 09:39:01.617138 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.617115 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgddt\" (UniqueName: \"kubernetes.io/projected/a847e3fc-3f8a-42d9-b095-96130025ee07-kube-api-access-dgddt\") pod \"monitoring-plugin-76b68cc874-t784m\" (UID: \"a847e3fc-3f8a-42d9-b095-96130025ee07\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.617227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.617178 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a847e3fc-3f8a-42d9-b095-96130025ee07-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-t784m\" (UID: \"a847e3fc-3f8a-42d9-b095-96130025ee07\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.680382 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.680353 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:01.718053 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.718023 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgddt\" (UniqueName: \"kubernetes.io/projected/a847e3fc-3f8a-42d9-b095-96130025ee07-kube-api-access-dgddt\") pod \"monitoring-plugin-76b68cc874-t784m\" (UID: \"a847e3fc-3f8a-42d9-b095-96130025ee07\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.718222 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.718087 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a847e3fc-3f8a-42d9-b095-96130025ee07-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-t784m\" (UID: \"a847e3fc-3f8a-42d9-b095-96130025ee07\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.720704 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.720678 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a847e3fc-3f8a-42d9-b095-96130025ee07-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-t784m\" (UID: \"a847e3fc-3f8a-42d9-b095-96130025ee07\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.728019 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.727992 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgddt\" (UniqueName: \"kubernetes.io/projected/a847e3fc-3f8a-42d9-b095-96130025ee07-kube-api-access-dgddt\") pod \"monitoring-plugin-76b68cc874-t784m\" (UID: \"a847e3fc-3f8a-42d9-b095-96130025ee07\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:01.781442 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.781408 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:01.912465 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:01.912385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:02.160269 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:02.160238 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-t784m"] Jun 11 09:39:03.135435 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.135343 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" event={"ID":"a847e3fc-3f8a-42d9-b095-96130025ee07","Type":"ContainerStarted","Data":"9cb88a1cf5607422dab9ba2b51fb0e1ff3e3c2de478ea4b7ff3da47b5b3a2169"} Jun 11 09:39:03.138250 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138224 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"619ebd8206625a744aa4eeb7a476c9f9cad36e672051cee2138108243cb9a788"} Jun 11 09:39:03.138366 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138278 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"bdab3ff2192fd59e52d946f743255654544ff2ec7fe39bc4a242c9a697cfd802"} Jun 11 09:39:03.138366 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138304 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"7cfaeb3f115b135e37347f604371e8fd3b6a35a2d16aa1d0429c9daba75a3392"} Jun 11 09:39:03.138366 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138330 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"7e71b71ef10202ae8898a1b32a14cc79a80dc7c943ad2ac932b573f53ada21c5"} Jun 11 09:39:03.138366 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138355 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"45996263c0093ee1e8587a95e8674ecf03c2319dd07e97861adbba793f3c4d92"} Jun 11 09:39:03.138529 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138384 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:03.138529 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.138409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" event={"ID":"f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf","Type":"ContainerStarted","Data":"631128c0b2c84dae9242492e4846c9f345eb3d9bb6833cbb0cdafe16bd3e0247"} Jun 11 09:39:03.169234 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.169182 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" podStartSLOduration=1.879009996 podStartE2EDuration="4.169167201s" totalImagesPullingTime="2.290157205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:38:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:03.167960924 +0000 UTC m=+270.418658523" watchObservedRunningTime="2026-06-11 09:39:03.169167201 +0000 UTC m=+270.419864778" Jun 11 09:39:03.214381 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.214343 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:03.846587 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.846538 2557 patch_prober.go:28] interesting pod/image-registry-74684f8cf7-t4cr5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 09:39:03.846749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:03.846606 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 09:39:04.143224 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:04.143186 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" event={"ID":"a847e3fc-3f8a-42d9-b095-96130025ee07","Type":"ContainerStarted","Data":"70e09fd9ffe32d50ed46483b8ccce7724a1ec644b2a088d0505f3bc2738aa0cf"} Jun 11 09:39:04.143493 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:04.143472 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:04.148058 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:04.148037 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" Jun 11 09:39:04.164825 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:04.164786 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-t784m" podStartSLOduration=1.621514893 podStartE2EDuration="3.164748416s" totalImagesPullingTime="1.543233523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:04.162794487 +0000 UTC m=+271.413492062" watchObservedRunningTime="2026-06-11 09:39:04.164748416 +0000 UTC m=+271.415445994" Jun 11 09:39:06.342104 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:06.342067 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:06.448067 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:06.448036 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:08.859649 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:08.859603 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" containerName="registry" containerID="cri-o://ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a" gracePeriod=30 Jun 11 09:39:09.098504 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.098482 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:39:09.149205 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.149142 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75bc84d886-q5jk9" Jun 11 09:39:09.161056 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.161028 2557 generic.go:356] "Generic (PLEG): container finished" podID="47a683a4-0c18-403f-a6ce-be61233e387a" containerID="ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a" exitCode=0 Jun 11 09:39:09.161194 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.161059 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" Jun 11 09:39:09.161194 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.161087 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" event={"ID":"47a683a4-0c18-403f-a6ce-be61233e387a","Type":"ContainerDied","Data":"ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a"} Jun 11 09:39:09.161194 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.161130 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74684f8cf7-t4cr5" event={"ID":"47a683a4-0c18-403f-a6ce-be61233e387a","Type":"ContainerDied","Data":"982f3d09451971c16cf30e152d02318b5ad769788fcba8a71032e408044c0bdc"} Jun 11 09:39:09.161194 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.161156 2557 scope.go:117] "RemoveContainer" containerID="ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a" Jun 11 09:39:09.168714 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.168697 2557 scope.go:117] "RemoveContainer" containerID="ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a" Jun 11 09:39:09.169065 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:39:09.169045 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a\": container with ID starting with ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a not found: ID does not exist" containerID="ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a" Jun 11 09:39:09.169115 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.169074 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a"} err="failed to get container status \"ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a\": rpc error: code = NotFound desc = could not find container \"ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a\": container with ID starting with ef7a8975c2c16f5d183406dc758e01ec50ebb46eb315ad11a4436fc868128d2a not found: ID does not exist" Jun 11 09:39:09.179643 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179624 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-image-registry-private-configuration\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.179744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179668 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgml8\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-kube-api-access-dgml8\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.179744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179698 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47a683a4-0c18-403f-a6ce-be61233e387a-ca-trust-extracted\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.179744 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179722 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-installation-pull-secrets\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.179910 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179777 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.179910 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179842 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-bound-sa-token\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.179910 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179886 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-trusted-ca\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.180054 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.179910 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-registry-certificates\") pod \"47a683a4-0c18-403f-a6ce-be61233e387a\" (UID: \"47a683a4-0c18-403f-a6ce-be61233e387a\") " Jun 11 09:39:09.181259 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.181232 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:39:09.181420 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.181243 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:39:09.183010 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.182934 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:39:09.183010 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.182938 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:39:09.183010 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.182990 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:39:09.183225 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.183035 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-kube-api-access-dgml8" (OuterVolumeSpecName: "kube-api-access-dgml8") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "kube-api-access-dgml8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:39:09.183388 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.183362 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:39:09.189909 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.189878 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a683a4-0c18-403f-a6ce-be61233e387a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "47a683a4-0c18-403f-a6ce-be61233e387a" (UID: "47a683a4-0c18-403f-a6ce-be61233e387a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 09:39:09.281516 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281471 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-bound-sa-token\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281516 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281507 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-trusted-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281516 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281516 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47a683a4-0c18-403f-a6ce-be61233e387a-registry-certificates\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281516 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281527 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-image-registry-private-configuration\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281537 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgml8\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-kube-api-access-dgml8\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281545 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47a683a4-0c18-403f-a6ce-be61233e387a-ca-trust-extracted\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281553 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47a683a4-0c18-403f-a6ce-be61233e387a-installation-pull-secrets\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.281810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.281561 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47a683a4-0c18-403f-a6ce-be61233e387a-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:39:09.482854 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.482820 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74684f8cf7-t4cr5"] Jun 11 09:39:09.486997 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:09.486971 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74684f8cf7-t4cr5"] Jun 11 09:39:11.175533 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.175497 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" path="/var/lib/kubelet/pods/47a683a4-0c18-403f-a6ce-be61233e387a/volumes" Jun 11 09:39:11.546005 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.545907 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7846955c5d-6zld2"] Jun 11 09:39:11.546005 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.545985 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:11.546193 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.546186 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" containerName="registry" Jun 11 09:39:11.546229 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.546197 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" containerName="registry" Jun 11 09:39:11.546276 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.546247 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a683a4-0c18-403f-a6ce-be61233e387a" containerName="registry" Jun 11 09:39:11.550919 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.550898 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.553964 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.553938 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 09:39:11.554095 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.554078 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 09:39:11.554164 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.553938 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 09:39:11.554888 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.554867 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 09:39:11.555180 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.555163 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 09:39:11.555180 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.555173 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9wwlz\"" Jun 11 09:39:11.555281 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.555164 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 09:39:11.555281 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.555194 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 09:39:11.559795 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.559754 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 09:39:11.560436 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.560415 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7846955c5d-6zld2"] Jun 11 09:39:11.598468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598440 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-oauth-config\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.598592 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-console-config\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.598592 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598545 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-service-ca\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.598592 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-oauth-serving-cert\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.598592 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598591 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d668l\" (UniqueName: \"kubernetes.io/projected/36add950-4183-4e89-9891-113abfcf2d81-kube-api-access-d668l\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.598779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598633 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-serving-cert\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.598779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.598656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-trusted-ca-bundle\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.659916 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.659883 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:11.699181 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699149 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-oauth-config\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.699323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699210 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-console-config\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.699323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699240 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-service-ca\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.699323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-oauth-serving-cert\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.699323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699276 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d668l\" (UniqueName: \"kubernetes.io/projected/36add950-4183-4e89-9891-113abfcf2d81-kube-api-access-d668l\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.699323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699293 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-serving-cert\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.699323 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.699313 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-trusted-ca-bundle\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.700123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.700093 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-oauth-serving-cert\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.700227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.700146 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-service-ca\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.700227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.700208 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-console-config\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.700356 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.700214 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-trusted-ca-bundle\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.701662 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.701640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-oauth-config\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.701882 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.701864 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-serving-cert\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.713734 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.713713 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d668l\" (UniqueName: \"kubernetes.io/projected/36add950-4183-4e89-9891-113abfcf2d81-kube-api-access-d668l\") pod \"console-7846955c5d-6zld2\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.792489 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.792458 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:11.861615 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.861583 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:11.991167 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:11.991142 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7846955c5d-6zld2"] Jun 11 09:39:11.993297 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:39:11.993269 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36add950_4183_4e89_9891_113abfcf2d81.slice/crio-64aebfe121f2b89baead18b9abe452cade233b3a275f7f6a6f3c1a9a280f8b00 WatchSource:0}: Error finding container 64aebfe121f2b89baead18b9abe452cade233b3a275f7f6a6f3c1a9a280f8b00: Status 404 returned error can't find the container with id 64aebfe121f2b89baead18b9abe452cade233b3a275f7f6a6f3c1a9a280f8b00 Jun 11 09:39:12.174466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:12.174380 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7846955c5d-6zld2" event={"ID":"36add950-4183-4e89-9891-113abfcf2d81","Type":"ContainerStarted","Data":"64aebfe121f2b89baead18b9abe452cade233b3a275f7f6a6f3c1a9a280f8b00"} Jun 11 09:39:13.337051 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:13.337013 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:13.438447 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:13.438417 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:13.794279 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:39:13.794228 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6jjjr" podUID="909b7c22-55ba-428c-b4fd-78e1f23b3268" Jun 11 09:39:14.181994 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:14.181962 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jjjr" Jun 11 09:39:15.186919 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:15.186881 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7846955c5d-6zld2" event={"ID":"36add950-4183-4e89-9891-113abfcf2d81","Type":"ContainerStarted","Data":"224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57"} Jun 11 09:39:15.219074 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:15.219021 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7846955c5d-6zld2" podStartSLOduration=1.700418386 podStartE2EDuration="4.219004638s" totalImagesPullingTime="2.518586252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:15.217586414 +0000 UTC m=+282.468283991" watchObservedRunningTime="2026-06-11 09:39:15.219004638 +0000 UTC m=+282.469702216" Jun 11 09:39:17.045690 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.045632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:39:17.047941 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.047923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/909b7c22-55ba-428c-b4fd-78e1f23b3268-metrics-tls\") pod \"dns-default-6jjjr\" (UID: \"909b7c22-55ba-428c-b4fd-78e1f23b3268\") " pod="openshift-dns/dns-default-6jjjr" Jun 11 09:39:17.185889 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.185861 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgk2h\"" Jun 11 09:39:17.193577 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.193553 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jjjr" Jun 11 09:39:17.259058 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.258986 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:17.335352 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.335327 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jjjr"] Jun 11 09:39:17.336733 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:39:17.336701 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909b7c22_55ba_428c_b4fd_78e1f23b3268.slice/crio-7c4386ffd267fb7392f43df86ce087c2ce3819a2b017b75ec022475c0c9c9e45 WatchSource:0}: Error finding container 7c4386ffd267fb7392f43df86ce087c2ce3819a2b017b75ec022475c0c9c9e45: Status 404 returned error can't find the container with id 7c4386ffd267fb7392f43df86ce087c2ce3819a2b017b75ec022475c0c9c9e45 Jun 11 09:39:17.348047 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:17.348020 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:18.198639 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:18.198602 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jjjr" event={"ID":"909b7c22-55ba-428c-b4fd-78e1f23b3268","Type":"ContainerStarted","Data":"7c4386ffd267fb7392f43df86ce087c2ce3819a2b017b75ec022475c0c9c9e45"} Jun 11 09:39:18.584388 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:18.584296 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:18.751364 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:18.751326 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:19.203238 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:19.203151 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jjjr" event={"ID":"909b7c22-55ba-428c-b4fd-78e1f23b3268","Type":"ContainerStarted","Data":"bd787a1c86ae1baa8e00a4fd3827a2795785c0f06f332a17be8eed9e464abb8a"} Jun 11 09:39:19.203238 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:19.203199 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jjjr" event={"ID":"909b7c22-55ba-428c-b4fd-78e1f23b3268","Type":"ContainerStarted","Data":"195b8dd2b9d6e40d3334da32a8fbb7fd26025f219f76cd4c193ec1d27d29b349"} Jun 11 09:39:19.203641 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:19.203277 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6jjjr" Jun 11 09:39:19.226305 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:19.226256 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6jjjr" podStartSLOduration=250.650833745 podStartE2EDuration="4m12.226240155s" totalImagesPullingTime="1.57540641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:39:19.224164282 +0000 UTC m=+286.474861860" watchObservedRunningTime="2026-06-11 09:39:19.226240155 +0000 UTC m=+286.476937732" Jun 11 09:39:21.862075 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:21.862040 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:21.862561 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:21.862128 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:21.863307 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:21.863284 2557 patch_prober.go:28] interesting pod/console-7846955c5d-6zld2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 09:39:21.863399 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:21.863328 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7846955c5d-6zld2" podUID="36add950-4183-4e89-9891-113abfcf2d81" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 09:39:26.230417 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:26.230382 2557 generic.go:356] "Generic (PLEG): container finished" podID="70493004-c3b5-4e1d-98a1-e9fc96e6bb5d" containerID="77f0c82fdb824fc81c4fd87df9672cb6a0d2383b870cea2790e4024c85bc1067" exitCode=0 Jun 11 09:39:26.230903 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:26.230455 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2fc2c" event={"ID":"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d","Type":"ContainerDied","Data":"77f0c82fdb824fc81c4fd87df9672cb6a0d2383b870cea2790e4024c85bc1067"} Jun 11 09:39:26.230903 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:26.230800 2557 scope.go:117] "RemoveContainer" containerID="77f0c82fdb824fc81c4fd87df9672cb6a0d2383b870cea2790e4024c85bc1067" Jun 11 09:39:27.235299 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:27.235263 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-2fc2c" event={"ID":"70493004-c3b5-4e1d-98a1-e9fc96e6bb5d","Type":"ContainerStarted","Data":"a025f2c9628197db94bb642f4477f17ae4807f806e45a02dca75be0f9bc112b6"} Jun 11 09:39:29.208810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:29.208780 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6jjjr" Jun 11 09:39:30.155466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:30.155431 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:30.230873 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:30.230842 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:30.569964 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:30.569885 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-k7gd4_7d161574-c5b5-4505-b2d2-0bf56323937e/cluster-monitoring-operator/0.log" Jun 11 09:39:31.253525 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:31.253487 2557 generic.go:356] "Generic (PLEG): container finished" podID="a71d589c-fbf5-4a15-a09b-b5288750948a" containerID="c355a3d4024002c154891c43351e580ffa998173b44d70cbdf079649f21a5ace" exitCode=0 Jun 11 09:39:31.253914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:31.253560 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" event={"ID":"a71d589c-fbf5-4a15-a09b-b5288750948a","Type":"ContainerDied","Data":"c355a3d4024002c154891c43351e580ffa998173b44d70cbdf079649f21a5ace"} Jun 11 09:39:31.253914 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:31.253879 2557 scope.go:117] "RemoveContainer" containerID="c355a3d4024002c154891c43351e580ffa998173b44d70cbdf079649f21a5ace" Jun 11 09:39:31.569954 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:31.569878 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-t784m_a847e3fc-3f8a-42d9-b095-96130025ee07/monitoring-plugin/0.log" Jun 11 09:39:31.866015 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:31.865985 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:31.870066 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:31.870043 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:39:32.259572 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:32.259486 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wr7lb" event={"ID":"a71d589c-fbf5-4a15-a09b-b5288750948a","Type":"ContainerStarted","Data":"7ac9e9b8025162f0376a10a53aaa0d760b9e028e688fad8647c04c19d0a7e9f4"} Jun 11 09:39:32.969270 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:32.969240 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbjnp_371e910d-ee33-468e-841c-8e186880f136/init-textfile/0.log" Jun 11 09:39:33.134399 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:33.134372 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 09:39:33.169960 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:33.169825 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbjnp_371e910d-ee33-468e-841c-8e186880f136/node-exporter/0.log" Jun 11 09:39:33.373372 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:33.373344 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbjnp_371e910d-ee33-468e-841c-8e186880f136/kube-rbac-proxy/0.log" Jun 11 09:39:34.586849 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:34.586803 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" podUID="8d762f53-eeae-43a5-9b1d-9470a3abbea7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 09:39:35.553096 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:35.553058 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:36.169900 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:36.169871 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/thanos-query/0.log" Jun 11 09:39:36.371970 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:36.371936 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy-web/0.log" Jun 11 09:39:36.568675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:36.568593 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy/0.log" Jun 11 09:39:36.639774 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:36.639737 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:36.768330 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:36.768299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/prom-label-proxy/0.log" Jun 11 09:39:36.969378 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:36.969349 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy-rules/0.log" Jun 11 09:39:37.160714 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:37.160681 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:37.168187 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:37.168164 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy-metrics/0.log" Jun 11 09:39:37.268074 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:37.267995 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:37.369529 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:37.369499 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-rlq5l_152671bc-056d-48aa-af5a-03ab6b2be264/networking-console-plugin/0.log" Jun 11 09:39:38.168772 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:38.168731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7846955c5d-6zld2_36add950-4183-4e89-9891-113abfcf2d81/console/0.log" Jun 11 09:39:38.380207 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:38.380171 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:38.478689 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:38.478619 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:38.568304 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:38.568278 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jjjr_909b7c22-55ba-428c-b4fd-78e1f23b3268/dns/0.log" Jun 11 09:39:38.768477 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:38.768399 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jjjr_909b7c22-55ba-428c-b4fd-78e1f23b3268/kube-rbac-proxy/0.log" Jun 11 09:39:39.770988 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:39.770961 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2dfw_c65cf062-90d4-41de-a2e1-6be061576475/dns-node-resolver/0.log" Jun 11 09:39:39.807861 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:39.807833 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:39.913969 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:39.913941 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:40.772971 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:40.772947 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5dhcg_8d87c275-3b60-46a1-ae16-8b8a83a371bc/node-ca/0.log" Jun 11 09:39:41.972271 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:41.972244 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjrrn_6f71ddba-ddd0-4c68-8627-c16833b90bb1/serve-healthcheck-canary/0.log" Jun 11 09:39:44.515201 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:44.515170 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:44.586910 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:44.586873 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" podUID="8d762f53-eeae-43a5-9b1d-9470a3abbea7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 09:39:44.612935 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:44.612876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:44.713310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:44.713275 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:44.814289 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:44.814219 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:47.464873 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:47.464839 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:47.570068 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:47.570029 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:48.098412 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:48.098361 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:48.214049 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:48.214021 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:48.311774 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:48.311724 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:51.731414 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:51.731374 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:51.830547 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:51.830514 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:54.586849 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:54.586803 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" podUID="8d762f53-eeae-43a5-9b1d-9470a3abbea7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 09:39:54.587207 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:54.586888 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" Jun 11 09:39:54.587371 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:54.587352 2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bd33087935709dcca0cf91e3d93c5aa740e9d3339ce12fdbc58f97aea68cfc8c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 09:39:54.587414 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:54.587390 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" podUID="8d762f53-eeae-43a5-9b1d-9470a3abbea7" containerName="service-proxy" containerID="cri-o://bd33087935709dcca0cf91e3d93c5aa740e9d3339ce12fdbc58f97aea68cfc8c" gracePeriod=30 Jun 11 09:39:55.348159 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:55.348124 2557 generic.go:356] "Generic (PLEG): container finished" podID="8d762f53-eeae-43a5-9b1d-9470a3abbea7" containerID="bd33087935709dcca0cf91e3d93c5aa740e9d3339ce12fdbc58f97aea68cfc8c" exitCode=2 Jun 11 09:39:55.348410 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:55.348195 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" event={"ID":"8d762f53-eeae-43a5-9b1d-9470a3abbea7","Type":"ContainerDied","Data":"bd33087935709dcca0cf91e3d93c5aa740e9d3339ce12fdbc58f97aea68cfc8c"} Jun 11 09:39:55.348410 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:55.348238 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-64d8b9fffc-fd5hd" event={"ID":"8d762f53-eeae-43a5-9b1d-9470a3abbea7","Type":"ContainerStarted","Data":"e3afdc48a18f81d476f31ee4e78c7d0f145628d322df7bd865b79d2f0f619f13"} Jun 11 09:39:56.596720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:56.596684 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:39:56.662395 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:39:56.662366 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:11.632629 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:11.632592 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:11.729465 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:11.729435 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:12.682599 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:12.682560 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:12.761478 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:12.761447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:16.258451 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:16.258368 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:16.561264 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:16.561177 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:25.984246 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:25.984200 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:26.075855 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:26.075820 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:26.172688 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:26.172646 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:26.672946 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:26.672906 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:26.750280 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:26.750248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:36.651815 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:36.651781 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7846955c5d-6zld2"] Jun 11 09:40:36.767509 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:36.767468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:36.879418 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:36.879368 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:36.940432 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:36.940361 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:41.599912 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:41.599879 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:41.702582 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:41.702548 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:57.205471 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:57.205426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:40:57.266567 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:40:57.266530 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:01.671946 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:01.671900 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7846955c5d-6zld2" podUID="36add950-4183-4e89-9891-113abfcf2d81" containerName="console" containerID="cri-o://224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57" gracePeriod=15 Jun 11 09:41:01.914138 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:01.914114 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:41:01.964984 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:01.964875 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:02.068474 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068441 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-oauth-serving-cert\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068489 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-oauth-config\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068508 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-console-config\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068529 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-trusted-ca-bundle\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068559 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d668l\" (UniqueName: \"kubernetes.io/projected/36add950-4183-4e89-9891-113abfcf2d81-kube-api-access-d668l\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068598 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-service-ca\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068627 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-serving-cert\") pod \"36add950-4183-4e89-9891-113abfcf2d81\" (UID: \"36add950-4183-4e89-9891-113abfcf2d81\") " Jun 11 09:41:02.068961 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068935 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:41:02.069009 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068942 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-console-config" (OuterVolumeSpecName: "console-config") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:41:02.069009 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.068970 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:41:02.069387 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.069355 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-service-ca" (OuterVolumeSpecName: "service-ca") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:41:02.071009 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.070976 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:41:02.071118 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.071024 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:41:02.071178 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.071140 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36add950-4183-4e89-9891-113abfcf2d81-kube-api-access-d668l" (OuterVolumeSpecName: "kube-api-access-d668l") pod "36add950-4183-4e89-9891-113abfcf2d81" (UID: "36add950-4183-4e89-9891-113abfcf2d81"). InnerVolumeSpecName "kube-api-access-d668l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:41:02.169804 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169753 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-oauth-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.169804 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169799 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-console-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.169804 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169811 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-trusted-ca-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.170035 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169823 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d668l\" (UniqueName: \"kubernetes.io/projected/36add950-4183-4e89-9891-113abfcf2d81-kube-api-access-d668l\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.170035 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169835 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.170035 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169857 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36add950-4183-4e89-9891-113abfcf2d81-console-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.170035 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.169869 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36add950-4183-4e89-9891-113abfcf2d81-oauth-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:41:02.589861 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.589826 2557 generic.go:356] "Generic (PLEG): container finished" podID="36add950-4183-4e89-9891-113abfcf2d81" containerID="224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57" exitCode=0 Jun 11 09:41:02.590054 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.589869 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7846955c5d-6zld2" Jun 11 09:41:02.590054 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.589918 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7846955c5d-6zld2" event={"ID":"36add950-4183-4e89-9891-113abfcf2d81","Type":"ContainerDied","Data":"224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57"} Jun 11 09:41:02.590054 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.589973 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7846955c5d-6zld2" event={"ID":"36add950-4183-4e89-9891-113abfcf2d81","Type":"ContainerDied","Data":"64aebfe121f2b89baead18b9abe452cade233b3a275f7f6a6f3c1a9a280f8b00"} Jun 11 09:41:02.590054 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.590005 2557 scope.go:117] "RemoveContainer" containerID="224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57" Jun 11 09:41:02.599226 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.599209 2557 scope.go:117] "RemoveContainer" containerID="224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57" Jun 11 09:41:02.599471 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:41:02.599452 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57\": container with ID starting with 224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57 not found: ID does not exist" containerID="224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57" Jun 11 09:41:02.599518 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.599479 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57"} err="failed to get container status \"224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57\": rpc error: code = NotFound desc = could not find container \"224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57\": container with ID starting with 224b9f3bb6341e7d845631a942242210dfeab8aba9ae5f8fe9490368f7249e57 not found: ID does not exist" Jun 11 09:41:02.612797 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.612774 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7846955c5d-6zld2"] Jun 11 09:41:02.617427 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.617409 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7846955c5d-6zld2"] Jun 11 09:41:02.867612 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.867516 2557 patch_prober.go:28] interesting pod/console-7846955c5d-6zld2 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.18:8443/health\": context deadline exceeded" start-of-body= Jun 11 09:41:02.868078 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:02.867613 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7846955c5d-6zld2" podUID="36add950-4183-4e89-9891-113abfcf2d81" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": context deadline exceeded" Jun 11 09:41:03.175416 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:03.175342 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36add950-4183-4e89-9891-113abfcf2d81" path="/var/lib/kubelet/pods/36add950-4183-4e89-9891-113abfcf2d81/volumes" Jun 11 09:41:31.604420 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:31.604379 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:31.801902 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:31.801870 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:43.486571 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:43.486530 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:43.565854 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:43.565808 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:56.604717 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:56.604627 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:56.704646 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:56.704589 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:56.900468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:56.900383 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:59.264015 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.263980 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59bc9dfdb7-fwjq9"] Jun 11 09:41:59.264367 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.264261 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36add950-4183-4e89-9891-113abfcf2d81" containerName="console" Jun 11 09:41:59.264367 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.264274 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="36add950-4183-4e89-9891-113abfcf2d81" containerName="console" Jun 11 09:41:59.264367 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.264328 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="36add950-4183-4e89-9891-113abfcf2d81" containerName="console" Jun 11 09:41:59.267252 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.267235 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.272786 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9wwlz\"" Jun 11 09:41:59.272925 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272825 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 09:41:59.272925 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272856 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 09:41:59.272925 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272894 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 09:41:59.272925 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272916 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 09:41:59.273145 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272746 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 09:41:59.273145 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.272892 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 09:41:59.273705 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.273418 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 09:41:59.281573 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.281545 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bc9dfdb7-fwjq9"] Jun 11 09:41:59.282439 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.282418 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 09:41:59.334701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.334665 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:59.394812 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.394754 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-config\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.394937 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.394815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbclj\" (UniqueName: \"kubernetes.io/projected/46f21edc-2588-4eed-a008-e9d9e871d7a3-kube-api-access-rbclj\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.394937 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.394905 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-serving-cert\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.395018 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.394937 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-trusted-ca-bundle\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.395018 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.394970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-oauth-serving-cert\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.395092 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.395050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-service-ca\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.395092 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.395082 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-oauth-config\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.411050 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.411019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:41:59.496073 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-oauth-serving-cert\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496083 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-service-ca\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496114 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-oauth-config\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496164 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-config\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496184 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbclj\" (UniqueName: \"kubernetes.io/projected/46f21edc-2588-4eed-a008-e9d9e871d7a3-kube-api-access-rbclj\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496221 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-serving-cert\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496477 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-trusted-ca-bundle\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.496976 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.496946 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-oauth-serving-cert\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.497101 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.497072 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-config\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.497145 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.497119 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-service-ca\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.497216 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.497197 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-trusted-ca-bundle\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.498675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.498651 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-serving-cert\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.498791 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.498688 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-oauth-config\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.506017 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.505993 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbclj\" (UniqueName: \"kubernetes.io/projected/46f21edc-2588-4eed-a008-e9d9e871d7a3-kube-api-access-rbclj\") pod \"console-59bc9dfdb7-fwjq9\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.580279 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.580191 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:41:59.713958 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.713920 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bc9dfdb7-fwjq9"] Jun 11 09:41:59.717942 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:41:59.717902 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f21edc_2588_4eed_a008_e9d9e871d7a3.slice/crio-0269b835d6638bf6ae07b44f518526e6db7925cd356c697eae67454e05b35b35 WatchSource:0}: Error finding container 0269b835d6638bf6ae07b44f518526e6db7925cd356c697eae67454e05b35b35: Status 404 returned error can't find the container with id 0269b835d6638bf6ae07b44f518526e6db7925cd356c697eae67454e05b35b35 Jun 11 09:41:59.791982 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.791941 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc9dfdb7-fwjq9" event={"ID":"46f21edc-2588-4eed-a008-e9d9e871d7a3","Type":"ContainerStarted","Data":"e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02"} Jun 11 09:41:59.792129 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.791998 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc9dfdb7-fwjq9" event={"ID":"46f21edc-2588-4eed-a008-e9d9e871d7a3","Type":"ContainerStarted","Data":"0269b835d6638bf6ae07b44f518526e6db7925cd356c697eae67454e05b35b35"} Jun 11 09:41:59.813178 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:41:59.813118 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59bc9dfdb7-fwjq9" podStartSLOduration=0.813100825 podStartE2EDuration="813.100825ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:41:59.811307146 +0000 UTC m=+447.062004750" watchObservedRunningTime="2026-06-11 09:41:59.813100825 +0000 UTC m=+447.063798403" Jun 11 09:42:09.580370 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:42:09.580329 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:42:09.580875 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:42:09.580399 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:42:09.585140 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:42:09.585117 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:42:09.834256 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:42:09.834181 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:42:10.145210 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:42:10.145181 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:42:10.243384 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:42:10.243350 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:43:02.606434 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:02.606397 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:43:16.491088 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:16.491011 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:43:40.965818 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:40.965777 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:43:41.060517 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.060484 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:43:41.837857 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.837817 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:43:41.852400 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.852373 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl"] Jun 11 09:43:41.855416 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.855401 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:43:41.858186 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.858167 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jun 11 09:43:41.859214 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.859199 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-zb5ts\"" Jun 11 09:43:41.859281 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.859266 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jun 11 09:43:41.863669 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.863646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbffg\" (UniqueName: \"kubernetes.io/projected/f73f6e64-2840-4844-b43c-d0b26206fc07-kube-api-access-dbffg\") pod \"feast-operator-controller-manager-86bd5bd8bb-nc5vl\" (UID: \"f73f6e64-2840-4844-b43c-d0b26206fc07\") " pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:43:41.869933 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.869914 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl"] Jun 11 09:43:41.965009 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.964966 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbffg\" (UniqueName: \"kubernetes.io/projected/f73f6e64-2840-4844-b43c-d0b26206fc07-kube-api-access-dbffg\") pod \"feast-operator-controller-manager-86bd5bd8bb-nc5vl\" (UID: \"f73f6e64-2840-4844-b43c-d0b26206fc07\") " pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:43:41.976524 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:41.976495 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbffg\" (UniqueName: \"kubernetes.io/projected/f73f6e64-2840-4844-b43c-d0b26206fc07-kube-api-access-dbffg\") pod \"feast-operator-controller-manager-86bd5bd8bb-nc5vl\" (UID: \"f73f6e64-2840-4844-b43c-d0b26206fc07\") " pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:43:42.165085 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:42.165058 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:43:42.302598 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:42.302508 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl"] Jun 11 09:43:42.305187 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:43:42.305157 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73f6e64_2840_4844_b43c_d0b26206fc07.slice/crio-806fa70f0d91ef0e74b58ab099fe06bd97e02507df8e78c8ab13d3c42d6b0364 WatchSource:0}: Error finding container 806fa70f0d91ef0e74b58ab099fe06bd97e02507df8e78c8ab13d3c42d6b0364: Status 404 returned error can't find the container with id 806fa70f0d91ef0e74b58ab099fe06bd97e02507df8e78c8ab13d3c42d6b0364 Jun 11 09:43:42.307088 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:42.307073 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 09:43:43.163298 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:43.163258 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" event={"ID":"f73f6e64-2840-4844-b43c-d0b26206fc07","Type":"ContainerStarted","Data":"806fa70f0d91ef0e74b58ab099fe06bd97e02507df8e78c8ab13d3c42d6b0364"} Jun 11 09:43:45.179886 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:45.179855 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" event={"ID":"f73f6e64-2840-4844-b43c-d0b26206fc07","Type":"ContainerStarted","Data":"f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21"} Jun 11 09:43:45.180228 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:45.179902 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:43:45.192224 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:45.192179 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" podStartSLOduration=1.686975613 podStartE2EDuration="4.192165243s" totalImagesPullingTime="2.50518963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:43:45.190665177 +0000 UTC m=+552.441362751" watchObservedRunningTime="2026-06-11 09:43:45.192165243 +0000 UTC m=+552.442862842" Jun 11 09:43:56.178321 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:43:56.178288 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:44:23.318907 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.318874 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:23.419491 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.419463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:23.638291 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.638260 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:23.738350 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.738321 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:23.823380 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.823349 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:23.896558 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.896474 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:23.994258 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:23.994226 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:44:24.058597 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:44:24.058564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:13.104937 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:13.104903 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:27.598639 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.598606 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc59f6849-7rx7g"] Jun 11 09:45:27.601954 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.601931 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.617405 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.617380 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc59f6849-7rx7g"] Jun 11 09:45:27.663029 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.662995 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3695c669-5915-4228-9aec-c57aeffeea57-console-serving-cert\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.663182 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.663037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-service-ca\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.663182 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.663057 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-console-config\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.663182 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.663136 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-trusted-ca-bundle\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.663182 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.663166 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3695c669-5915-4228-9aec-c57aeffeea57-console-oauth-config\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.663346 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.663185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6j4p\" (UniqueName: \"kubernetes.io/projected/3695c669-5915-4228-9aec-c57aeffeea57-kube-api-access-x6j4p\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.663346 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.663204 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-oauth-serving-cert\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.675819 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.675788 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:27.764197 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764159 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3695c669-5915-4228-9aec-c57aeffeea57-console-serving-cert\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.764360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-service-ca\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.764360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-console-config\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.764360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764249 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-trusted-ca-bundle\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.764360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3695c669-5915-4228-9aec-c57aeffeea57-console-oauth-config\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.764360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764281 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6j4p\" (UniqueName: \"kubernetes.io/projected/3695c669-5915-4228-9aec-c57aeffeea57-kube-api-access-x6j4p\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.764360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.764298 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-oauth-serving-cert\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.765180 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.765150 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-service-ca\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.765301 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.765159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-oauth-serving-cert\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.765349 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.765301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-console-config\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.765408 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.765389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3695c669-5915-4228-9aec-c57aeffeea57-trusted-ca-bundle\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.766632 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.766613 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3695c669-5915-4228-9aec-c57aeffeea57-console-serving-cert\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.766737 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.766653 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3695c669-5915-4228-9aec-c57aeffeea57-console-oauth-config\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.774222 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.774202 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6j4p\" (UniqueName: \"kubernetes.io/projected/3695c669-5915-4228-9aec-c57aeffeea57-kube-api-access-x6j4p\") pod \"console-7bc59f6849-7rx7g\" (UID: \"3695c669-5915-4228-9aec-c57aeffeea57\") " pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:27.776430 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.776401 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:27.849369 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.849291 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:27.911550 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:27.911517 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:28.044097 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:28.044068 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc59f6849-7rx7g"] Jun 11 09:45:28.047121 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:45:28.047094 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3695c669_5915_4228_9aec_c57aeffeea57.slice/crio-cf04e60bb9b9ab3fe5f1285f717215360a9c3dc8e8f41b866478e44746ac5b6f WatchSource:0}: Error finding container cf04e60bb9b9ab3fe5f1285f717215360a9c3dc8e8f41b866478e44746ac5b6f: Status 404 returned error can't find the container with id cf04e60bb9b9ab3fe5f1285f717215360a9c3dc8e8f41b866478e44746ac5b6f Jun 11 09:45:28.538825 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:28.538715 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc59f6849-7rx7g" event={"ID":"3695c669-5915-4228-9aec-c57aeffeea57","Type":"ContainerStarted","Data":"9785e74abe4e85c4f34954e49a18c4271f5b5b38438fcc18840e140a3af091c7"} Jun 11 09:45:28.538825 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:28.538798 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc59f6849-7rx7g" event={"ID":"3695c669-5915-4228-9aec-c57aeffeea57","Type":"ContainerStarted","Data":"cf04e60bb9b9ab3fe5f1285f717215360a9c3dc8e8f41b866478e44746ac5b6f"} Jun 11 09:45:28.543808 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:28.543748 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:28.565024 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:28.564976 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc59f6849-7rx7g" podStartSLOduration=1.564964041 podStartE2EDuration="1.564964041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:45:28.562947199 +0000 UTC m=+655.813644779" watchObservedRunningTime="2026-06-11 09:45:28.564964041 +0000 UTC m=+655.815661620" Jun 11 09:45:28.675810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:28.675741 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:37.911654 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:37.911613 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:37.912082 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:37.911685 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:37.916439 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:37.916417 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:38.581580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:38.581552 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc59f6849-7rx7g" Jun 11 09:45:38.632703 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:38.632672 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bc9dfdb7-fwjq9"] Jun 11 09:45:38.745440 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:38.745392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:38.849360 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:38.849332 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:38.918376 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:38.918330 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:46.317120 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:46.317081 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:45:46.420167 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:45:46.420126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:03.657968 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.657902 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59bc9dfdb7-fwjq9" podUID="46f21edc-2588-4eed-a008-e9d9e871d7a3" containerName="console" containerID="cri-o://e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02" gracePeriod=15 Jun 11 09:46:03.894536 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.894509 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:46:03.965197 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965106 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbclj\" (UniqueName: \"kubernetes.io/projected/46f21edc-2588-4eed-a008-e9d9e871d7a3-kube-api-access-rbclj\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965197 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965152 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-oauth-config\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965197 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965182 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-trusted-ca-bundle\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965205 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-oauth-serving-cert\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965320 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-service-ca\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965383 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-config\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965461 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965428 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-serving-cert\") pod \"46f21edc-2588-4eed-a008-e9d9e871d7a3\" (UID: \"46f21edc-2588-4eed-a008-e9d9e871d7a3\") " Jun 11 09:46:03.965658 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965594 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:46:03.965778 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965701 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:46:03.965857 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965812 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:46:03.965989 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.965969 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-config" (OuterVolumeSpecName: "console-config") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 09:46:03.967447 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.967416 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:46:03.967447 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.967432 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:46:03.967584 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:03.967448 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46f21edc-2588-4eed-a008-e9d9e871d7a3-kube-api-access-rbclj" (OuterVolumeSpecName: "kube-api-access-rbclj") pod "46f21edc-2588-4eed-a008-e9d9e871d7a3" (UID: "46f21edc-2588-4eed-a008-e9d9e871d7a3"). InnerVolumeSpecName "kube-api-access-rbclj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:46:04.066004 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.065962 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbclj\" (UniqueName: \"kubernetes.io/projected/46f21edc-2588-4eed-a008-e9d9e871d7a3-kube-api-access-rbclj\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.066004 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.066000 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-oauth-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.066004 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.066013 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-trusted-ca-bundle\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.066227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.066023 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-oauth-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.066227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.066036 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-service-ca\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.066227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.066048 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-config\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.066227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.066060 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46f21edc-2588-4eed-a008-e9d9e871d7a3-console-serving-cert\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:46:04.676803 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.676755 2557 generic.go:356] "Generic (PLEG): container finished" podID="46f21edc-2588-4eed-a008-e9d9e871d7a3" containerID="e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02" exitCode=0 Jun 11 09:46:04.677195 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.676816 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc9dfdb7-fwjq9" Jun 11 09:46:04.677195 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.676836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc9dfdb7-fwjq9" event={"ID":"46f21edc-2588-4eed-a008-e9d9e871d7a3","Type":"ContainerDied","Data":"e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02"} Jun 11 09:46:04.677195 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.676875 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc9dfdb7-fwjq9" event={"ID":"46f21edc-2588-4eed-a008-e9d9e871d7a3","Type":"ContainerDied","Data":"0269b835d6638bf6ae07b44f518526e6db7925cd356c697eae67454e05b35b35"} Jun 11 09:46:04.677195 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.676894 2557 scope.go:117] "RemoveContainer" containerID="e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02" Jun 11 09:46:04.685499 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.685479 2557 scope.go:117] "RemoveContainer" containerID="e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02" Jun 11 09:46:04.685785 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:46:04.685742 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02\": container with ID starting with e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02 not found: ID does not exist" containerID="e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02" Jun 11 09:46:04.685843 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.685786 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02"} err="failed to get container status \"e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02\": rpc error: code = NotFound desc = could not find container \"e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02\": container with ID starting with e5ff32eae0d9837e73e6cd9f285f53bc0fff694027702fde3d9cb4de46097a02 not found: ID does not exist" Jun 11 09:46:04.701125 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.701098 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bc9dfdb7-fwjq9"] Jun 11 09:46:04.708792 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:04.708772 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59bc9dfdb7-fwjq9"] Jun 11 09:46:05.174945 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:05.174914 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46f21edc-2588-4eed-a008-e9d9e871d7a3" path="/var/lib/kubelet/pods/46f21edc-2588-4eed-a008-e9d9e871d7a3/volumes" Jun 11 09:46:15.081061 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.081011 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:15.223630 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.223595 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:15.335478 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.335397 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:15.434299 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.434261 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:15.565872 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.565800 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:15.838594 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.838565 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:15.906537 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:15.906500 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:46:35.240884 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:46:35.240843 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:36.778253 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:36.778217 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:36.871033 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:36.870994 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:36.971614 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:36.971581 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:37.070986 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:37.070901 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:37.269563 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:37.269530 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:37.457530 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:37.457498 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:37.777220 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:37.777139 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:47:56.832872 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:47:56.832838 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:48:58.530543 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:48:58.530486 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:48:58.733048 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:48:58.733013 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:48:58.971093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:48:58.971057 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:03.952040 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:03.952009 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:31.633921 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:31.633839 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:43.238438 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:43.238405 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:43.584857 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:43.584775 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:43.729882 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:43.729840 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:54.251070 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:54.251033 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:54.427840 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:54.427802 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:54.670125 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:54.670088 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:49:55.092325 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:49:55.092297 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:50:16.809749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:16.809716 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:50:19.195314 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.195281 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-6mc7n"] Jun 11 09:50:19.195675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.195551 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46f21edc-2588-4eed-a008-e9d9e871d7a3" containerName="console" Jun 11 09:50:19.195675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.195562 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="46f21edc-2588-4eed-a008-e9d9e871d7a3" containerName="console" Jun 11 09:50:19.195675 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.195616 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="46f21edc-2588-4eed-a008-e9d9e871d7a3" containerName="console" Jun 11 09:50:19.198402 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.198385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:19.201010 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.200983 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jun 11 09:50:19.201332 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.201318 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-22xrd\"" Jun 11 09:50:19.202279 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.202262 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 11 09:50:19.202344 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.202299 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 11 09:50:19.209233 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.209212 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-6mc7n"] Jun 11 09:50:19.327990 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.327955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrwd6\" (UniqueName: \"kubernetes.io/projected/e6a9d22c-c77b-42a7-93f5-977c48f4f48a-kube-api-access-xrwd6\") pod \"feast-test-apply-6mc7n\" (UID: \"e6a9d22c-c77b-42a7-93f5-977c48f4f48a\") " pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:19.429221 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.429184 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrwd6\" (UniqueName: \"kubernetes.io/projected/e6a9d22c-c77b-42a7-93f5-977c48f4f48a-kube-api-access-xrwd6\") pod \"feast-test-apply-6mc7n\" (UID: \"e6a9d22c-c77b-42a7-93f5-977c48f4f48a\") " pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:19.439847 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.439821 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrwd6\" (UniqueName: \"kubernetes.io/projected/e6a9d22c-c77b-42a7-93f5-977c48f4f48a-kube-api-access-xrwd6\") pod \"feast-test-apply-6mc7n\" (UID: \"e6a9d22c-c77b-42a7-93f5-977c48f4f48a\") " pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:19.507457 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.507376 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:19.645275 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.645241 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-6mc7n"] Jun 11 09:50:19.649205 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:50:19.649181 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6a9d22c_c77b_42a7_93f5_977c48f4f48a.slice/crio-8354bc70498ffd7db43c5320e3b816c4d383ad099775506ae636d2d1366b66d0 WatchSource:0}: Error finding container 8354bc70498ffd7db43c5320e3b816c4d383ad099775506ae636d2d1366b66d0: Status 404 returned error can't find the container with id 8354bc70498ffd7db43c5320e3b816c4d383ad099775506ae636d2d1366b66d0 Jun 11 09:50:19.650983 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:19.650966 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 09:50:20.622160 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:20.622112 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-6mc7n" event={"ID":"e6a9d22c-c77b-42a7-93f5-977c48f4f48a","Type":"ContainerStarted","Data":"8354bc70498ffd7db43c5320e3b816c4d383ad099775506ae636d2d1366b66d0"} Jun 11 09:50:24.641389 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:24.641353 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-6mc7n" event={"ID":"e6a9d22c-c77b-42a7-93f5-977c48f4f48a","Type":"ContainerStarted","Data":"a45d902a3c69ea27d038cef1021d2f2b4b26716c46bc46108fee7fa1fd87345c"} Jun 11 09:50:30.664183 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:30.664147 2557 generic.go:356] "Generic (PLEG): container finished" podID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerID="a45d902a3c69ea27d038cef1021d2f2b4b26716c46bc46108fee7fa1fd87345c" exitCode=0 Jun 11 09:50:30.664655 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:30.664220 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-6mc7n" event={"ID":"e6a9d22c-c77b-42a7-93f5-977c48f4f48a","Type":"ContainerDied","Data":"a45d902a3c69ea27d038cef1021d2f2b4b26716c46bc46108fee7fa1fd87345c"} Jun 11 09:50:31.669348 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:31.669313 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-6mc7n" event={"ID":"e6a9d22c-c77b-42a7-93f5-977c48f4f48a","Type":"ContainerStarted","Data":"39f08b66b2a22159da71a016c8151fe9f4d4363bb13fd32957f16f451cb987b0"} Jun 11 09:50:31.691375 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:31.691324 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-6mc7n" podStartSLOduration=2.260165658 podStartE2EDuration="12.691309268s" totalImagesPullingTime="4.420602287s" totalInitContainerRuntime="6.010541323s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:50:31.690157747 +0000 UTC m=+958.940855327" watchObservedRunningTime="2026-06-11 09:50:31.691309268 +0000 UTC m=+958.942006845" Jun 11 09:50:37.212580 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:37.212546 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:50:37.276605 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:37.276557 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:50:39.700241 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:39.700202 2557 generic.go:356] "Generic (PLEG): container finished" podID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerID="39f08b66b2a22159da71a016c8151fe9f4d4363bb13fd32957f16f451cb987b0" exitCode=0 Jun 11 09:50:39.700592 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:39.700255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-6mc7n" event={"ID":"e6a9d22c-c77b-42a7-93f5-977c48f4f48a","Type":"ContainerDied","Data":"39f08b66b2a22159da71a016c8151fe9f4d4363bb13fd32957f16f451cb987b0"} Jun 11 09:50:40.830586 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:40.830558 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:40.889691 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:40.889655 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrwd6\" (UniqueName: \"kubernetes.io/projected/e6a9d22c-c77b-42a7-93f5-977c48f4f48a-kube-api-access-xrwd6\") pod \"e6a9d22c-c77b-42a7-93f5-977c48f4f48a\" (UID: \"e6a9d22c-c77b-42a7-93f5-977c48f4f48a\") " Jun 11 09:50:40.891833 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:40.891804 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a9d22c-c77b-42a7-93f5-977c48f4f48a-kube-api-access-xrwd6" (OuterVolumeSpecName: "kube-api-access-xrwd6") pod "e6a9d22c-c77b-42a7-93f5-977c48f4f48a" (UID: "e6a9d22c-c77b-42a7-93f5-977c48f4f48a"). InnerVolumeSpecName "kube-api-access-xrwd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:50:40.990140 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:40.990057 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrwd6\" (UniqueName: \"kubernetes.io/projected/e6a9d22c-c77b-42a7-93f5-977c48f4f48a-kube-api-access-xrwd6\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:50:41.709234 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:41.709207 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-6mc7n" Jun 11 09:50:41.709405 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:41.709235 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-6mc7n" event={"ID":"e6a9d22c-c77b-42a7-93f5-977c48f4f48a","Type":"ContainerDied","Data":"8354bc70498ffd7db43c5320e3b816c4d383ad099775506ae636d2d1366b66d0"} Jun 11 09:50:41.709405 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:41.709269 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8354bc70498ffd7db43c5320e3b816c4d383ad099775506ae636d2d1366b66d0" Jun 11 09:50:41.888633 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:41.888600 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-6mc7n_e6a9d22c-c77b-42a7-93f5-977c48f4f48a/feast-1/0.log" Jun 11 09:50:41.894650 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:41.894625 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-6mc7n_e6a9d22c-c77b-42a7-93f5-977c48f4f48a/feast-0/0.log" Jun 11 09:50:53.668951 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:50:53.668915 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:12.562924 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:12.562882 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:17.525812 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:17.525775 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-6mc7n"] Jun 11 09:51:17.534412 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:17.534380 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-6mc7n"] Jun 11 09:51:17.653542 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:17.653498 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:19.175162 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:19.175125 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" path="/var/lib/kubelet/pods/e6a9d22c-c77b-42a7-93f5-977c48f4f48a/volumes" Jun 11 09:51:44.380343 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:44.380308 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:55.208345 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:55.208314 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:55.616870 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:55.616837 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:55.713800 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:55.713753 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:55.812405 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:55.812373 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:55.951232 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:55.951143 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:56.101938 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:56.101900 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:56.400455 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:56.400423 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:56.557301 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:56.557268 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:56.658731 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:56.658651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:51:56.884824 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:51:56.884787 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:41.597082 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:41.597030 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:41.699543 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:41.699504 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:41.803862 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:41.803830 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:47.322647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:47.322564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:52.792622 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:52.792576 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:52.890345 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:52.890299 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:53.101429 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:53.101397 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:53:53.417623 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:53:53.417507 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:54:15.406956 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:54:15.406919 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:54:18.660619 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:54:18.660579 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:54:18.763642 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:54:18.763600 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:54:18.916995 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:54:18.916914 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:54:19.179199 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:54:19.179110 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:26.005386 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:26.005296 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:27.050715 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:27.050674 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:54.449947 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:54.449911 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:56.478930 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:56.478887 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:57.017870 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.017835 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl"] Jun 11 09:55:57.018129 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.018023 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" podUID="f73f6e64-2840-4844-b43c-d0b26206fc07" containerName="manager" containerID="cri-o://f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21" gracePeriod=10 Jun 11 09:55:57.022849 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.022820 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:57.262309 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.262284 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:55:57.345607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.345576 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbffg\" (UniqueName: \"kubernetes.io/projected/f73f6e64-2840-4844-b43c-d0b26206fc07-kube-api-access-dbffg\") pod \"f73f6e64-2840-4844-b43c-d0b26206fc07\" (UID: \"f73f6e64-2840-4844-b43c-d0b26206fc07\") " Jun 11 09:55:57.347739 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.347708 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f73f6e64-2840-4844-b43c-d0b26206fc07-kube-api-access-dbffg" (OuterVolumeSpecName: "kube-api-access-dbffg") pod "f73f6e64-2840-4844-b43c-d0b26206fc07" (UID: "f73f6e64-2840-4844-b43c-d0b26206fc07"). InnerVolumeSpecName "kube-api-access-dbffg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:55:57.446949 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.446906 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbffg\" (UniqueName: \"kubernetes.io/projected/f73f6e64-2840-4844-b43c-d0b26206fc07-kube-api-access-dbffg\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:55:57.886286 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.886260 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" Jun 11 09:55:57.886666 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.886254 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" event={"ID":"f73f6e64-2840-4844-b43c-d0b26206fc07","Type":"ContainerDied","Data":"f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21"} Jun 11 09:55:57.886666 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.886210 2557 generic.go:356] "Generic (PLEG): container finished" podID="f73f6e64-2840-4844-b43c-d0b26206fc07" containerID="f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21" exitCode=0 Jun 11 09:55:57.886666 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.886490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl" event={"ID":"f73f6e64-2840-4844-b43c-d0b26206fc07","Type":"ContainerDied","Data":"806fa70f0d91ef0e74b58ab099fe06bd97e02507df8e78c8ab13d3c42d6b0364"} Jun 11 09:55:57.887465 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.886391 2557 scope.go:117] "RemoveContainer" containerID="f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21" Jun 11 09:55:57.897124 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.897104 2557 scope.go:117] "RemoveContainer" containerID="f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21" Jun 11 09:55:57.897401 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:55:57.897380 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21\": container with ID starting with f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21 not found: ID does not exist" containerID="f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21" Jun 11 09:55:57.897508 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.897411 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21"} err="failed to get container status \"f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21\": rpc error: code = NotFound desc = could not find container \"f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21\": container with ID starting with f91d8d49f8c9807cf6e51ca4e4ea6e929e85afd01016a22120e3939bfb8c2d21 not found: ID does not exist" Jun 11 09:55:57.926733 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.926706 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl"] Jun 11 09:55:57.927662 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.927643 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:57.941109 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:57.941081 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-86bd5bd8bb-nc5vl"] Jun 11 09:55:58.200549 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:58.200442 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:55:59.175022 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:59.174989 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f73f6e64-2840-4844-b43c-d0b26206fc07" path="/var/lib/kubelet/pods/f73f6e64-2840-4844-b43c-d0b26206fc07/volumes" Jun 11 09:55:59.587952 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:55:59.587867 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:04.163631 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:04.163597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:04.373205 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:04.373172 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:09.680079 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:09.680043 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:10.041952 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.041850 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:10.820241 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.820200 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:10.899791 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.899744 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j"] Jun 11 09:56:10.900047 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900035 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f73f6e64-2840-4844-b43c-d0b26206fc07" containerName="manager" Jun 11 09:56:10.900093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900049 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f73f6e64-2840-4844-b43c-d0b26206fc07" containerName="manager" Jun 11 09:56:10.900093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900057 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerName="feast-1" Jun 11 09:56:10.900093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900063 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerName="feast-1" Jun 11 09:56:10.900093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900071 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerName="feast-0" Jun 11 09:56:10.900093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900076 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerName="feast-0" Jun 11 09:56:10.900249 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900131 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a9d22c-c77b-42a7-93f5-977c48f4f48a" containerName="feast-1" Jun 11 09:56:10.900249 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.900141 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f73f6e64-2840-4844-b43c-d0b26206fc07" containerName="manager" Jun 11 09:56:10.904276 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.904256 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:10.907684 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.907656 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jun 11 09:56:10.907820 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.907723 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-jvv4g\"" Jun 11 09:56:10.908620 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.908604 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jun 11 09:56:10.942667 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:10.942641 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j"] Jun 11 09:56:11.058274 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.058236 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kctbf\" (UniqueName: \"kubernetes.io/projected/5a0c388f-bb16-4511-83e5-556fb250d869-kube-api-access-kctbf\") pod \"feast-operator-controller-manager-6d54c7db9d-5wn7j\" (UID: \"5a0c388f-bb16-4511-83e5-556fb250d869\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:11.159423 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.159385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kctbf\" (UniqueName: \"kubernetes.io/projected/5a0c388f-bb16-4511-83e5-556fb250d869-kube-api-access-kctbf\") pod \"feast-operator-controller-manager-6d54c7db9d-5wn7j\" (UID: \"5a0c388f-bb16-4511-83e5-556fb250d869\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:11.181970 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.181936 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kctbf\" (UniqueName: \"kubernetes.io/projected/5a0c388f-bb16-4511-83e5-556fb250d869-kube-api-access-kctbf\") pod \"feast-operator-controller-manager-6d54c7db9d-5wn7j\" (UID: \"5a0c388f-bb16-4511-83e5-556fb250d869\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:11.214317 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.214286 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:11.369058 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.369032 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j"] Jun 11 09:56:11.371288 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:56:11.371259 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0c388f_bb16_4511_83e5_556fb250d869.slice/crio-3c57de0bfaaec1c39f80059843e0688c49fa0859cb80732d6d1a3d50185eab04 WatchSource:0}: Error finding container 3c57de0bfaaec1c39f80059843e0688c49fa0859cb80732d6d1a3d50185eab04: Status 404 returned error can't find the container with id 3c57de0bfaaec1c39f80059843e0688c49fa0859cb80732d6d1a3d50185eab04 Jun 11 09:56:11.373284 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.373267 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 09:56:11.940700 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:11.940614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" event={"ID":"5a0c388f-bb16-4511-83e5-556fb250d869","Type":"ContainerStarted","Data":"3c57de0bfaaec1c39f80059843e0688c49fa0859cb80732d6d1a3d50185eab04"} Jun 11 09:56:12.946213 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:12.946179 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" event={"ID":"5a0c388f-bb16-4511-83e5-556fb250d869","Type":"ContainerStarted","Data":"543778f2d02425b3a78d2e3c05cce33c210a44ea5649640f39b495a1541c3337"} Jun 11 09:56:12.946586 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:12.946275 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:12.989828 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:12.989776 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" podStartSLOduration=1.5567743269999998 podStartE2EDuration="2.989741094s" totalImagesPullingTime="1.432966767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:56:12.987024349 +0000 UTC m=+1300.237721926" watchObservedRunningTime="2026-06-11 09:56:12.989741094 +0000 UTC m=+1300.240438671" Jun 11 09:56:23.952641 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:23.952609 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 09:56:25.079963 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.079928 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:25.269100 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.269064 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:25.572110 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.572080 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:25.683527 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.683491 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:25.761399 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.761360 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7"] Jun 11 09:56:25.764898 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.764877 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.767558 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767530 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jun 11 09:56:25.767684 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767558 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jun 11 09:56:25.767684 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767615 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jun 11 09:56:25.767684 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767623 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 11 09:56:25.767684 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767646 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5dtdk\"" Jun 11 09:56:25.767916 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9flkd\" (UniqueName: \"kubernetes.io/projected/2924680d-39f5-48dd-960c-e01e08029f5c-kube-api-access-9flkd\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.767961 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767920 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2924680d-39f5-48dd-960c-e01e08029f5c-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.768013 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.767969 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jun 11 09:56:25.768013 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.768000 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.768096 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.768041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.768096 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.768073 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 11 09:56:25.768173 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.768078 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.768173 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.768158 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.780626 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.780602 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7"] Jun 11 09:56:25.868702 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.868672 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9flkd\" (UniqueName: \"kubernetes.io/projected/2924680d-39f5-48dd-960c-e01e08029f5c-kube-api-access-9flkd\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.868901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.868717 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2924680d-39f5-48dd-960c-e01e08029f5c-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.868901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.868750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.868901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.868809 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.868901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.868838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.868901 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.868868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.868904 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.868955 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.868976 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.868995 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.869011 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls podName:2924680d-39f5-48dd-960c-e01e08029f5c nodeName:}" failed. No retries permitted until 2026-06-11 09:56:26.368988192 +0000 UTC m=+1313.619685762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls") pod "feast-simple-feast-setup-75c64c888b-8ndw7" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c") : secret "feast-simple-feast-setup-ui-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.869032 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls podName:2924680d-39f5-48dd-960c-e01e08029f5c nodeName:}" failed. No retries permitted until 2026-06-11 09:56:26.36902229 +0000 UTC m=+1313.619719849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls") pod "feast-simple-feast-setup-75c64c888b-8ndw7" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c") : secret "feast-simple-feast-setup-registry-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.869049 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls podName:2924680d-39f5-48dd-960c-e01e08029f5c nodeName:}" failed. No retries permitted until 2026-06-11 09:56:26.369037568 +0000 UTC m=+1313.619735133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls") pod "feast-simple-feast-setup-75c64c888b-8ndw7" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c") : secret "feast-simple-feast-setup-online-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:56:25.869064 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls podName:2924680d-39f5-48dd-960c-e01e08029f5c nodeName:}" failed. No retries permitted until 2026-06-11 09:56:26.36905752 +0000 UTC m=+1313.619755076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls") pod "feast-simple-feast-setup-75c64c888b-8ndw7" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c") : secret "feast-simple-feast-setup-offline-tls" not found Jun 11 09:56:25.869147 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.869136 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2924680d-39f5-48dd-960c-e01e08029f5c-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.880048 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.880022 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9flkd\" (UniqueName: \"kubernetes.io/projected/2924680d-39f5-48dd-960c-e01e08029f5c-kube-api-access-9flkd\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:25.971183 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:25.971140 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:26.133173 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.133084 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:26.372237 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.372199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.372423 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.372252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.372423 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.372285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.372423 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.372315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.374595 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.374563 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.374750 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.374732 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.374892 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.374797 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.374892 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.374816 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8ndw7\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.674511 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.674468 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:26.813910 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:26.813887 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7"] Jun 11 09:56:26.815587 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:56:26.815558 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2924680d_39f5_48dd_960c_e01e08029f5c.slice/crio-bcc3fb77ccef7e1bec5011c5cce82187e7847fcd4ad994a041df5351d46c6127 WatchSource:0}: Error finding container bcc3fb77ccef7e1bec5011c5cce82187e7847fcd4ad994a041df5351d46c6127: Status 404 returned error can't find the container with id bcc3fb77ccef7e1bec5011c5cce82187e7847fcd4ad994a041df5351d46c6127 Jun 11 09:56:27.005366 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:27.005282 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"bcc3fb77ccef7e1bec5011c5cce82187e7847fcd4ad994a041df5351d46c6127"} Jun 11 09:56:33.215712 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:33.215678 2557 scope.go:117] "RemoveContainer" containerID="39f08b66b2a22159da71a016c8151fe9f4d4363bb13fd32957f16f451cb987b0" Jun 11 09:56:33.552430 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:33.552405 2557 scope.go:117] "RemoveContainer" containerID="a45d902a3c69ea27d038cef1021d2f2b4b26716c46bc46108fee7fa1fd87345c" Jun 11 09:56:37.617259 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:37.617220 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:37.900800 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:37.900703 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:38.004690 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:38.004647 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:38.202527 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:38.202443 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:56:41.071617 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:41.071519 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"0f1620de56b8faae1c12c1a71aaaae81b8dbbfad21b8bf84398839d5b5fd16f3"} Jun 11 09:56:46.095446 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:46.095409 2557 generic.go:356] "Generic (PLEG): container finished" podID="2924680d-39f5-48dd-960c-e01e08029f5c" containerID="0f1620de56b8faae1c12c1a71aaaae81b8dbbfad21b8bf84398839d5b5fd16f3" exitCode=0 Jun 11 09:56:46.095446 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:46.095449 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"0f1620de56b8faae1c12c1a71aaaae81b8dbbfad21b8bf84398839d5b5fd16f3"} Jun 11 09:56:47.102348 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:47.102314 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"60f47847c3ab88fbb75e6097aa3240c0f955e7c6ed8c3e15c506504932d46a4b"} Jun 11 09:56:52.124328 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:52.124291 2557 generic.go:356] "Generic (PLEG): container finished" podID="2924680d-39f5-48dd-960c-e01e08029f5c" containerID="60f47847c3ab88fbb75e6097aa3240c0f955e7c6ed8c3e15c506504932d46a4b" exitCode=0 Jun 11 09:56:52.124701 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:52.124360 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"60f47847c3ab88fbb75e6097aa3240c0f955e7c6ed8c3e15c506504932d46a4b"} Jun 11 09:56:53.133824 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.133785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"afe8c8afd4a6ece44d99476035d48abc1adf1cd3af7d803d8c1b970c7439b77c"} Jun 11 09:56:53.134304 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.133849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"c18772705663070d82429b8fcb5c2c4fad11646bdd7b482c5a0eed4fcef69de8"} Jun 11 09:56:53.134304 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.133871 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"cd5f33baf881addbee0b9dafbf87f0dc83f42844307709c39d393f9984cd1447"} Jun 11 09:56:53.134304 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.133890 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerStarted","Data":"646e47b70572e89b20f1d839cfa7eb168e729b8b7978f7f05947df2d1e43880f"} Jun 11 09:56:53.168229 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.168156 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podStartSLOduration=14.272781446 podStartE2EDuration="28.168129068s" totalImagesPullingTime="13.895347622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:56:53.165183506 +0000 UTC m=+1340.415881085" watchObservedRunningTime="2026-06-11 09:56:53.168129068 +0000 UTC m=+1340.418826647" Jun 11 09:56:53.674815 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.674770 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:53.675651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.675626 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:53.675829 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.675659 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:53.675829 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.675678 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:53.677308 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.677145 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Jun 11 09:56:53.677308 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.677161 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Jun 11 09:56:53.677308 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.677204 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused" Jun 11 09:56:53.677308 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:53.677207 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jun 11 09:56:56.675647 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.675589 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:56.676161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.675961 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:56.676161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.675987 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:56.676161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.675830 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Jun 11 09:56:56.676161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.676005 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:56.676161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.675885 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused" Jun 11 09:56:56.676161 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.675846 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused" Jun 11 09:56:56.676673 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:56.676635 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jun 11 09:56:59.675695 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:59.675660 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:59.676171 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:59.676032 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:59.676492 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:59.676468 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:59.676609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:59.676544 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:59.676609 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:59.676594 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:56:59.680234 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:56:59.680206 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:57:00.170612 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:57:00.170579 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:57:00.172857 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:57:00.172836 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:57:31.947122 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:57:31.947087 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:58:02.986173 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:02.986137 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7"] Jun 11 09:58:02.986783 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:02.986426 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="registry" containerID="cri-o://646e47b70572e89b20f1d839cfa7eb168e729b8b7978f7f05947df2d1e43880f" gracePeriod=30 Jun 11 09:58:02.986783 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:02.986544 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="offline" containerID="cri-o://c18772705663070d82429b8fcb5c2c4fad11646bdd7b482c5a0eed4fcef69de8" gracePeriod=30 Jun 11 09:58:02.986783 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:02.986601 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" containerID="cri-o://cd5f33baf881addbee0b9dafbf87f0dc83f42844307709c39d393f9984cd1447" gracePeriod=30 Jun 11 09:58:02.986783 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:02.986699 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" containerID="cri-o://afe8c8afd4a6ece44d99476035d48abc1adf1cd3af7d803d8c1b970c7439b77c" gracePeriod=30 Jun 11 09:58:03.433794 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.433738 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds"] Jun 11 09:58:03.437438 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.437411 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.440959 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.440934 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-qt4qd\"" Jun 11 09:58:03.457740 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.457711 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds"] Jun 11 09:58:03.567308 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.567274 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49c3360c-4547-4117-b461-924192976d8f-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.567308 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.567313 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.567511 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.567366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.567511 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.567397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.567511 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.567413 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlcq\" (UniqueName: \"kubernetes.io/projected/49c3360c-4547-4117-b461-924192976d8f-kube-api-access-6wlcq\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.567511 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.567489 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.668582 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.668552 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49c3360c-4547-4117-b461-924192976d8f-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.668749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.668587 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.668749 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.668723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.668889 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.668754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.668889 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.668803 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlcq\" (UniqueName: \"kubernetes.io/projected/49c3360c-4547-4117-b461-924192976d8f-kube-api-access-6wlcq\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.668889 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.668854 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.669047 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:58:03.668931 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jun 11 09:58:03.669047 ip-10-0-137-96 kubenswrapper[2557]: E0611 09:58:03.669029 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls podName:49c3360c-4547-4117-b461-924192976d8f nodeName:}" failed. No retries permitted until 2026-06-11 09:58:04.169009875 +0000 UTC m=+1411.419707447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls") pod "feast-simple-feast-setup-75c64c888b-kctds" (UID: "49c3360c-4547-4117-b461-924192976d8f") : secret "feast-simple-feast-setup-ui-tls" not found Jun 11 09:58:03.669146 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.669047 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49c3360c-4547-4117-b461-924192976d8f-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.671272 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.671248 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.671409 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.671356 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.671409 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.671376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.671731 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.671712 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:58:03.680553 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.680523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlcq\" (UniqueName: \"kubernetes.io/projected/49c3360c-4547-4117-b461-924192976d8f-kube-api-access-6wlcq\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:03.774564 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.774532 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:58:03.872925 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:03.872892 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:58:04.172980 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.172942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:04.175215 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.175194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-kctds\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:04.347235 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.347198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:04.413924 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.413891 2557 generic.go:356] "Generic (PLEG): container finished" podID="2924680d-39f5-48dd-960c-e01e08029f5c" containerID="afe8c8afd4a6ece44d99476035d48abc1adf1cd3af7d803d8c1b970c7439b77c" exitCode=0 Jun 11 09:58:04.413924 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.413921 2557 generic.go:356] "Generic (PLEG): container finished" podID="2924680d-39f5-48dd-960c-e01e08029f5c" containerID="cd5f33baf881addbee0b9dafbf87f0dc83f42844307709c39d393f9984cd1447" exitCode=0 Jun 11 09:58:04.414100 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.413956 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"afe8c8afd4a6ece44d99476035d48abc1adf1cd3af7d803d8c1b970c7439b77c"} Jun 11 09:58:04.414100 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.413998 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"cd5f33baf881addbee0b9dafbf87f0dc83f42844307709c39d393f9984cd1447"} Jun 11 09:58:04.489833 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:04.489807 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds"] Jun 11 09:58:04.491430 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:58:04.491405 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49c3360c_4547_4117_b461_924192976d8f.slice/crio-7498615fc705f11d48edd37d76606e3a4ab0b42f8ca5aa1a2db5a4d101dfbd03 WatchSource:0}: Error finding container 7498615fc705f11d48edd37d76606e3a4ab0b42f8ca5aa1a2db5a4d101dfbd03: Status 404 returned error can't find the container with id 7498615fc705f11d48edd37d76606e3a4ab0b42f8ca5aa1a2db5a4d101dfbd03 Jun 11 09:58:05.419665 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:05.419629 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"9904ad8e0dca313ebdd96de2bf04284e10cb86bd5bdf9ddf8b9312d76f999e0b"} Jun 11 09:58:05.420120 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:05.419675 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"7498615fc705f11d48edd37d76606e3a4ab0b42f8ca5aa1a2db5a4d101dfbd03"} Jun 11 09:58:09.436692 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:09.436652 2557 generic.go:356] "Generic (PLEG): container finished" podID="49c3360c-4547-4117-b461-924192976d8f" containerID="9904ad8e0dca313ebdd96de2bf04284e10cb86bd5bdf9ddf8b9312d76f999e0b" exitCode=0 Jun 11 09:58:09.437094 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:09.436733 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"9904ad8e0dca313ebdd96de2bf04284e10cb86bd5bdf9ddf8b9312d76f999e0b"} Jun 11 09:58:10.170596 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:10.170546 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Jun 11 09:58:10.170596 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:10.170566 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jun 11 09:58:10.442570 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:10.442469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"a59cbb3852ab483abc1ca51bdfc7620615d6797368bde6e8ebb7e9aa0489548f"} Jun 11 09:58:15.463073 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:15.463038 2557 generic.go:356] "Generic (PLEG): container finished" podID="49c3360c-4547-4117-b461-924192976d8f" containerID="a59cbb3852ab483abc1ca51bdfc7620615d6797368bde6e8ebb7e9aa0489548f" exitCode=0 Jun 11 09:58:15.463448 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:15.463111 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"a59cbb3852ab483abc1ca51bdfc7620615d6797368bde6e8ebb7e9aa0489548f"} Jun 11 09:58:16.474371 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:16.474331 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"b43554938dbceea88f96b951738d2d20044eefc9f98178ef735ed04f40fc86c6"} Jun 11 09:58:16.474881 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:16.474394 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"fa25c719716b0bb106f4459e9a85494d47e977051d2ad6b43b61cf2dfd595e9e"} Jun 11 09:58:16.474881 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:16.474416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"8bb15f46453640d9ed5471dfea542b024a42391edef65d924c5bd273cc04ce4e"} Jun 11 09:58:16.474881 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:16.474435 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerStarted","Data":"b8af18c57b62fd4e1eb55091ee37cc9e369dbc43f589e98583d458dc1946aae3"} Jun 11 09:58:16.506229 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:16.506165 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podStartSLOduration=13.506142844 podStartE2EDuration="13.506142844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:58:16.505875868 +0000 UTC m=+1423.756573473" watchObservedRunningTime="2026-06-11 09:58:16.506142844 +0000 UTC m=+1423.756840425" Jun 11 09:58:19.348029 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.347989 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:19.348591 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.348565 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:19.348591 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.348599 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:19.348790 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.348618 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:19.350052 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.350012 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jun 11 09:58:19.350160 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.350098 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Jun 11 09:58:19.350220 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.350023 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Jun 11 09:58:19.350420 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:19.350396 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 11 09:58:20.170709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:20.170649 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Jun 11 09:58:20.170709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:20.170667 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jun 11 09:58:22.349066 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349033 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349428 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349169 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349473 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349452 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349696 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349567 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349696 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349613 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349696 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349630 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349932 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349913 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.349996 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.349982 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.350057 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.350045 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.353509 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.353489 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.510593 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.510557 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:22.513484 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:22.513462 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 09:58:30.171093 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:30.171042 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused" Jun 11 09:58:30.171466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:30.171103 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused" Jun 11 09:58:30.171466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:30.171196 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:58:30.171466 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:30.171246 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:58:33.556840 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.556811 2557 generic.go:356] "Generic (PLEG): container finished" podID="2924680d-39f5-48dd-960c-e01e08029f5c" containerID="c18772705663070d82429b8fcb5c2c4fad11646bdd7b482c5a0eed4fcef69de8" exitCode=137 Jun 11 09:58:33.556840 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.556838 2557 generic.go:356] "Generic (PLEG): container finished" podID="2924680d-39f5-48dd-960c-e01e08029f5c" containerID="646e47b70572e89b20f1d839cfa7eb168e729b8b7978f7f05947df2d1e43880f" exitCode=137 Jun 11 09:58:33.557184 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.556879 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"c18772705663070d82429b8fcb5c2c4fad11646bdd7b482c5a0eed4fcef69de8"} Jun 11 09:58:33.557184 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.556918 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"646e47b70572e89b20f1d839cfa7eb168e729b8b7978f7f05947df2d1e43880f"} Jun 11 09:58:33.642823 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.642799 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:58:33.711942 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.711914 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls\") pod \"2924680d-39f5-48dd-960c-e01e08029f5c\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " Jun 11 09:58:33.712123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.711955 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls\") pod \"2924680d-39f5-48dd-960c-e01e08029f5c\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " Jun 11 09:58:33.712123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.711998 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls\") pod \"2924680d-39f5-48dd-960c-e01e08029f5c\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " Jun 11 09:58:33.712123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.712012 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls\") pod \"2924680d-39f5-48dd-960c-e01e08029f5c\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " Jun 11 09:58:33.712123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.712045 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2924680d-39f5-48dd-960c-e01e08029f5c-feast-data\") pod \"2924680d-39f5-48dd-960c-e01e08029f5c\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " Jun 11 09:58:33.712123 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.712074 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9flkd\" (UniqueName: \"kubernetes.io/projected/2924680d-39f5-48dd-960c-e01e08029f5c-kube-api-access-9flkd\") pod \"2924680d-39f5-48dd-960c-e01e08029f5c\" (UID: \"2924680d-39f5-48dd-960c-e01e08029f5c\") " Jun 11 09:58:33.712651 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.712614 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2924680d-39f5-48dd-960c-e01e08029f5c-feast-data" (OuterVolumeSpecName: "feast-data") pod "2924680d-39f5-48dd-960c-e01e08029f5c" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 09:58:33.714310 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.714281 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls" (OuterVolumeSpecName: "online-tls") pod "2924680d-39f5-48dd-960c-e01e08029f5c" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:58:33.714620 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.714586 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2924680d-39f5-48dd-960c-e01e08029f5c" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:58:33.714620 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.714601 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2924680d-39f5-48dd-960c-e01e08029f5c" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:58:33.714779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.714657 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2924680d-39f5-48dd-960c-e01e08029f5c-kube-api-access-9flkd" (OuterVolumeSpecName: "kube-api-access-9flkd") pod "2924680d-39f5-48dd-960c-e01e08029f5c" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c"). InnerVolumeSpecName "kube-api-access-9flkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 09:58:33.714779 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.714670 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2924680d-39f5-48dd-960c-e01e08029f5c" (UID: "2924680d-39f5-48dd-960c-e01e08029f5c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 09:58:33.812995 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.812925 2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-ui-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:58:33.812995 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.812950 2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-offline-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:58:33.812995 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.812962 2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2924680d-39f5-48dd-960c-e01e08029f5c-feast-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:58:33.812995 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.812970 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9flkd\" (UniqueName: \"kubernetes.io/projected/2924680d-39f5-48dd-960c-e01e08029f5c-kube-api-access-9flkd\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:58:33.813228 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.813038 2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-online-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:58:33.813228 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:33.813063 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2924680d-39f5-48dd-960c-e01e08029f5c-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 09:58:34.564322 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.564279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" event={"ID":"2924680d-39f5-48dd-960c-e01e08029f5c","Type":"ContainerDied","Data":"bcc3fb77ccef7e1bec5011c5cce82187e7847fcd4ad994a041df5351d46c6127"} Jun 11 09:58:34.564322 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.564315 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7" Jun 11 09:58:34.564894 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.564333 2557 scope.go:117] "RemoveContainer" containerID="afe8c8afd4a6ece44d99476035d48abc1adf1cd3af7d803d8c1b970c7439b77c" Jun 11 09:58:34.573518 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.573497 2557 scope.go:117] "RemoveContainer" containerID="c18772705663070d82429b8fcb5c2c4fad11646bdd7b482c5a0eed4fcef69de8" Jun 11 09:58:34.580656 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.580639 2557 scope.go:117] "RemoveContainer" containerID="cd5f33baf881addbee0b9dafbf87f0dc83f42844307709c39d393f9984cd1447" Jun 11 09:58:34.587946 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.587915 2557 scope.go:117] "RemoveContainer" containerID="646e47b70572e89b20f1d839cfa7eb168e729b8b7978f7f05947df2d1e43880f" Jun 11 09:58:34.594662 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.594641 2557 scope.go:117] "RemoveContainer" containerID="60f47847c3ab88fbb75e6097aa3240c0f955e7c6ed8c3e15c506504932d46a4b" Jun 11 09:58:34.601655 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.601639 2557 scope.go:117] "RemoveContainer" containerID="0f1620de56b8faae1c12c1a71aaaae81b8dbbfad21b8bf84398839d5b5fd16f3" Jun 11 09:58:34.605542 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.605522 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7"] Jun 11 09:58:34.617582 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:34.617556 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8ndw7"] Jun 11 09:58:35.176025 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:58:35.175993 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" path="/var/lib/kubelet/pods/2924680d-39f5-48dd-960c-e01e08029f5c/volumes" Jun 11 09:59:09.620641 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:09.620598 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:21.339532 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:21.339496 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:24.654468 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:24.654432 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:24.754552 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:24.754520 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:25.088972 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.088938 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:25.193720 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.193685 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:25.210305 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210278 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6"] Jun 11 09:59:25.210565 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210553 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="feast-init" Jun 11 09:59:25.210607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210566 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="feast-init" Jun 11 09:59:25.210607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210577 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" Jun 11 09:59:25.210607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210584 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" Jun 11 09:59:25.210607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210592 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="registry" Jun 11 09:59:25.210607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210597 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="registry" Jun 11 09:59:25.210607 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210604 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210611 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210625 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="offline" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210630 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="offline" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210637 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="feast-apply" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210642 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="feast-apply" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210692 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="offline" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210698 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="ui" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210703 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="registry" Jun 11 09:59:25.210810 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.210710 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2924680d-39f5-48dd-960c-e01e08029f5c" containerName="online" Jun 11 09:59:25.213924 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.213908 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.216457 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.216425 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jun 11 09:59:25.216457 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.216452 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jun 11 09:59:25.216864 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.216845 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jun 11 09:59:25.217045 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.217026 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jun 11 09:59:25.217121 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.217103 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jun 11 09:59:25.217209 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.217191 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-k576x\"" Jun 11 09:59:25.217317 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.217300 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jun 11 09:59:25.231685 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.231662 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6"] Jun 11 09:59:25.324599 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.324561 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.324817 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.324606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/22e9de24-6994-40d2-bd2d-aa327d0a68d8-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.324817 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.324661 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swxj2\" (UniqueName: \"kubernetes.io/projected/22e9de24-6994-40d2-bd2d-aa327d0a68d8-kube-api-access-swxj2\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.324817 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.324709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.324817 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.324791 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/22e9de24-6994-40d2-bd2d-aa327d0a68d8-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.324968 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.324822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.340223 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.340156 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:25.425525 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.425487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.425709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.425535 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.425709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.425565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/22e9de24-6994-40d2-bd2d-aa327d0a68d8-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.425709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.425585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swxj2\" (UniqueName: \"kubernetes.io/projected/22e9de24-6994-40d2-bd2d-aa327d0a68d8-kube-api-access-swxj2\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.425709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.425607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.425709 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.425644 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/22e9de24-6994-40d2-bd2d-aa327d0a68d8-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.426135 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.426099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/22e9de24-6994-40d2-bd2d-aa327d0a68d8-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.426395 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.426376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/22e9de24-6994-40d2-bd2d-aa327d0a68d8-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.428127 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.428097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.428227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.428132 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.428227 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.428190 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.435216 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.435180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swxj2\" (UniqueName: \"kubernetes.io/projected/22e9de24-6994-40d2-bd2d-aa327d0a68d8-kube-api-access-swxj2\") pod \"feast-simple-feast-remote-setup-669bcf45fc-nl2v6\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.436974 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.436950 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:25.523509 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.523473 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:25.537421 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.537395 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:25.673035 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.673011 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6"] Jun 11 09:59:25.675435 ip-10-0-137-96 kubenswrapper[2557]: W0611 09:59:25.675403 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22e9de24_6994_40d2_bd2d_aa327d0a68d8.slice/crio-2a4656bcb4d452d9d22f3cd1993ec3ca7a5292cdf99e7bd920714960556ac227 WatchSource:0}: Error finding container 2a4656bcb4d452d9d22f3cd1993ec3ca7a5292cdf99e7bd920714960556ac227: Status 404 returned error can't find the container with id 2a4656bcb4d452d9d22f3cd1993ec3ca7a5292cdf99e7bd920714960556ac227 Jun 11 09:59:25.773224 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.773195 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerStarted","Data":"8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2"} Jun 11 09:59:25.773377 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:25.773236 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerStarted","Data":"2a4656bcb4d452d9d22f3cd1993ec3ca7a5292cdf99e7bd920714960556ac227"} Jun 11 09:59:30.798009 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:30.797975 2557 generic.go:356] "Generic (PLEG): container finished" podID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerID="8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2" exitCode=0 Jun 11 09:59:30.798381 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:30.798047 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerDied","Data":"8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2"} Jun 11 09:59:31.803333 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:31.803297 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerStarted","Data":"021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450"} Jun 11 09:59:36.833191 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:36.833104 2557 generic.go:356] "Generic (PLEG): container finished" podID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerID="021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450" exitCode=0 Jun 11 09:59:36.833529 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:36.833185 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerDied","Data":"021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450"} Jun 11 09:59:37.841995 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:37.841958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerStarted","Data":"3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2"} Jun 11 09:59:37.842465 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:37.842007 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerStarted","Data":"1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a"} Jun 11 09:59:37.842465 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:37.842023 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerStarted","Data":"795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92"} Jun 11 09:59:37.873416 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:37.873349 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podStartSLOduration=12.873329847 podStartE2EDuration="12.873329847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 09:59:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 09:59:37.872183995 +0000 UTC m=+1505.122881592" watchObservedRunningTime="2026-06-11 09:59:37.873329847 +0000 UTC m=+1505.124027426" Jun 11 09:59:40.523707 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:40.523660 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:40.524321 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:40.523732 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:40.524321 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:40.523752 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:40.525055 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:40.525022 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused" Jun 11 09:59:40.525176 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:40.525045 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jun 11 09:59:40.525176 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:40.525021 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jun 11 09:59:42.842908 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:42.842872 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 09:59:43.525013 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.524982 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.525434 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.525409 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.525514 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.525453 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.525752 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.525730 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.529257 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.529240 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.872153 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.872115 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.872645 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.872162 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.872645 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.872640 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 09:59:43.875105 ip-10-0-137-96 kubenswrapper[2557]: I0611 09:59:43.875087 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 10:00:46.505063 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.505029 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:00:46.511905 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.511878 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6"] Jun 11 10:00:46.512191 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.512162 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" containerID="cri-o://795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92" gracePeriod=30 Jun 11 10:00:46.512392 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.512182 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" containerID="cri-o://3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2" gracePeriod=30 Jun 11 10:00:46.512496 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.512207 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="offline" containerID="cri-o://1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a" gracePeriod=30 Jun 11 10:00:46.684719 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.684681 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds"] Jun 11 10:00:46.684946 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.684917 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="registry" containerID="cri-o://b8af18c57b62fd4e1eb55091ee37cc9e369dbc43f589e98583d458dc1946aae3" gracePeriod=30 Jun 11 10:00:46.685050 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.685026 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" containerID="cri-o://8bb15f46453640d9ed5471dfea542b024a42391edef65d924c5bd273cc04ce4e" gracePeriod=30 Jun 11 10:00:46.685121 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.685042 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" containerID="cri-o://b43554938dbceea88f96b951738d2d20044eefc9f98178ef735ed04f40fc86c6" gracePeriod=30 Jun 11 10:00:46.685121 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:46.685049 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="offline" containerID="cri-o://fa25c719716b0bb106f4459e9a85494d47e977051d2ad6b43b61cf2dfd595e9e" gracePeriod=30 Jun 11 10:00:47.126535 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:47.126495 2557 generic.go:356] "Generic (PLEG): container finished" podID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerID="3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2" exitCode=0 Jun 11 10:00:47.126743 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:47.126571 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerDied","Data":"3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2"} Jun 11 10:00:47.625604 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:47.625576 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:00:48.133381 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:48.133347 2557 generic.go:356] "Generic (PLEG): container finished" podID="49c3360c-4547-4117-b461-924192976d8f" containerID="b43554938dbceea88f96b951738d2d20044eefc9f98178ef735ed04f40fc86c6" exitCode=0 Jun 11 10:00:48.133381 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:48.133375 2557 generic.go:356] "Generic (PLEG): container finished" podID="49c3360c-4547-4117-b461-924192976d8f" containerID="8bb15f46453640d9ed5471dfea542b024a42391edef65d924c5bd273cc04ce4e" exitCode=0 Jun 11 10:00:48.133601 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:48.133414 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"b43554938dbceea88f96b951738d2d20044eefc9f98178ef735ed04f40fc86c6"} Jun 11 10:00:48.133601 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:48.133453 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"8bb15f46453640d9ed5471dfea542b024a42391edef65d924c5bd273cc04ce4e"} Jun 11 10:00:48.135953 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:48.135930 2557 generic.go:356] "Generic (PLEG): container finished" podID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerID="795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92" exitCode=0 Jun 11 10:00:48.136067 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:48.135958 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerDied","Data":"795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92"} Jun 11 10:00:51.845843 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:51.845805 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:00:52.349863 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:52.349817 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jun 11 10:00:52.510989 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:52.510944 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 11 10:00:53.526219 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:53.526177 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jun 11 10:00:53.873136 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:00:53.873088 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jun 11 10:01:02.349916 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:02.349871 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jun 11 10:01:02.511487 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:02.511442 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 11 10:01:03.526293 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:03.526254 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jun 11 10:01:03.872661 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:03.872609 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jun 11 10:01:12.350636 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:12.350591 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Jun 11 10:01:12.351095 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:12.350752 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 10:01:12.511831 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:12.511784 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Jun 11 10:01:12.512010 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:12.511923 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 10:01:13.526537 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:13.526498 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Jun 11 10:01:13.526956 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:13.526636 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 10:01:13.872307 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:13.872266 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Jun 11 10:01:13.872476 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:13.872382 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 10:01:17.160296 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.160268 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 10:01:17.247875 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.247827 2557 generic.go:356] "Generic (PLEG): container finished" podID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerID="1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a" exitCode=137 Jun 11 10:01:17.248073 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.247883 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" Jun 11 10:01:17.248073 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.247897 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerDied","Data":"1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a"} Jun 11 10:01:17.248073 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.247942 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6" event={"ID":"22e9de24-6994-40d2-bd2d-aa327d0a68d8","Type":"ContainerDied","Data":"2a4656bcb4d452d9d22f3cd1993ec3ca7a5292cdf99e7bd920714960556ac227"} Jun 11 10:01:17.248073 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.247962 2557 scope.go:117] "RemoveContainer" containerID="3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2" Jun 11 10:01:17.251024 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251001 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-online-tls\") pod \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " Jun 11 10:01:17.251153 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251043 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-ui-tls\") pod \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " Jun 11 10:01:17.251153 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251063 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/22e9de24-6994-40d2-bd2d-aa327d0a68d8-registry-tls\") pod \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " Jun 11 10:01:17.251153 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251086 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/22e9de24-6994-40d2-bd2d-aa327d0a68d8-feast-data\") pod \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " Jun 11 10:01:17.251153 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251118 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-offline-tls\") pod \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " Jun 11 10:01:17.251153 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251151 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swxj2\" (UniqueName: \"kubernetes.io/projected/22e9de24-6994-40d2-bd2d-aa327d0a68d8-kube-api-access-swxj2\") pod \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\" (UID: \"22e9de24-6994-40d2-bd2d-aa327d0a68d8\") " Jun 11 10:01:17.251743 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251587 2557 generic.go:356] "Generic (PLEG): container finished" podID="49c3360c-4547-4117-b461-924192976d8f" containerID="fa25c719716b0bb106f4459e9a85494d47e977051d2ad6b43b61cf2dfd595e9e" exitCode=137 Jun 11 10:01:17.251743 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251618 2557 generic.go:356] "Generic (PLEG): container finished" podID="49c3360c-4547-4117-b461-924192976d8f" containerID="b8af18c57b62fd4e1eb55091ee37cc9e369dbc43f589e98583d458dc1946aae3" exitCode=137 Jun 11 10:01:17.251743 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251678 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"fa25c719716b0bb106f4459e9a85494d47e977051d2ad6b43b61cf2dfd595e9e"} Jun 11 10:01:17.251743 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251714 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"b8af18c57b62fd4e1eb55091ee37cc9e369dbc43f589e98583d458dc1946aae3"} Jun 11 10:01:17.252011 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.251938 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22e9de24-6994-40d2-bd2d-aa327d0a68d8-feast-data" (OuterVolumeSpecName: "feast-data") pod "22e9de24-6994-40d2-bd2d-aa327d0a68d8" (UID: "22e9de24-6994-40d2-bd2d-aa327d0a68d8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 10:01:17.252236 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.252184 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22e9de24-6994-40d2-bd2d-aa327d0a68d8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "22e9de24-6994-40d2-bd2d-aa327d0a68d8" (UID: "22e9de24-6994-40d2-bd2d-aa327d0a68d8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:01:17.253376 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.253351 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "22e9de24-6994-40d2-bd2d-aa327d0a68d8" (UID: "22e9de24-6994-40d2-bd2d-aa327d0a68d8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.253617 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.253591 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-online-tls" (OuterVolumeSpecName: "online-tls") pod "22e9de24-6994-40d2-bd2d-aa327d0a68d8" (UID: "22e9de24-6994-40d2-bd2d-aa327d0a68d8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.253617 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.253608 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22e9de24-6994-40d2-bd2d-aa327d0a68d8-kube-api-access-swxj2" (OuterVolumeSpecName: "kube-api-access-swxj2") pod "22e9de24-6994-40d2-bd2d-aa327d0a68d8" (UID: "22e9de24-6994-40d2-bd2d-aa327d0a68d8"). InnerVolumeSpecName "kube-api-access-swxj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:01:17.254214 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.254186 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "22e9de24-6994-40d2-bd2d-aa327d0a68d8" (UID: "22e9de24-6994-40d2-bd2d-aa327d0a68d8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.258538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.258520 2557 scope.go:117] "RemoveContainer" containerID="1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a" Jun 11 10:01:17.267578 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.267556 2557 scope.go:117] "RemoveContainer" containerID="795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92" Jun 11 10:01:17.276546 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.276524 2557 scope.go:117] "RemoveContainer" containerID="021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450" Jun 11 10:01:17.284124 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.284097 2557 scope.go:117] "RemoveContainer" containerID="8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2" Jun 11 10:01:17.291217 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.291200 2557 scope.go:117] "RemoveContainer" containerID="3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2" Jun 11 10:01:17.291516 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:01:17.291497 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2\": container with ID starting with 3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2 not found: ID does not exist" containerID="3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2" Jun 11 10:01:17.291566 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.291527 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2"} err="failed to get container status \"3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2\": rpc error: code = NotFound desc = could not find container \"3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2\": container with ID starting with 3ce4ccd19cd6daca2cf5fed23f1e37a3000bed0934ea6de22a5a8b3c12d05bb2 not found: ID does not exist" Jun 11 10:01:17.291566 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.291547 2557 scope.go:117] "RemoveContainer" containerID="1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a" Jun 11 10:01:17.291873 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:01:17.291855 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a\": container with ID starting with 1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a not found: ID does not exist" containerID="1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a" Jun 11 10:01:17.291944 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.291880 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a"} err="failed to get container status \"1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a\": rpc error: code = NotFound desc = could not find container \"1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a\": container with ID starting with 1611e59ce4d257ed9849c19904ebd3f3efb75d9ef9f067348fa2ec07239a4e6a not found: ID does not exist" Jun 11 10:01:17.291944 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.291897 2557 scope.go:117] "RemoveContainer" containerID="795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92" Jun 11 10:01:17.292171 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:01:17.292153 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92\": container with ID starting with 795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92 not found: ID does not exist" containerID="795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92" Jun 11 10:01:17.292217 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.292174 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92"} err="failed to get container status \"795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92\": rpc error: code = NotFound desc = could not find container \"795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92\": container with ID starting with 795446a049464b8a799f85d6b0469786e7c380b85ec6e1407dafde8fd47f1f92 not found: ID does not exist" Jun 11 10:01:17.292217 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.292187 2557 scope.go:117] "RemoveContainer" containerID="021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450" Jun 11 10:01:17.292433 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:01:17.292414 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450\": container with ID starting with 021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450 not found: ID does not exist" containerID="021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450" Jun 11 10:01:17.292478 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.292451 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450"} err="failed to get container status \"021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450\": rpc error: code = NotFound desc = could not find container \"021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450\": container with ID starting with 021c04f5eafd21fe760ad209758ad121e2e482a69f501ea71a61de597c95f450 not found: ID does not exist" Jun 11 10:01:17.292478 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.292465 2557 scope.go:117] "RemoveContainer" containerID="8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2" Jun 11 10:01:17.292690 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:01:17.292673 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2\": container with ID starting with 8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2 not found: ID does not exist" containerID="8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2" Jun 11 10:01:17.292738 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.292692 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2"} err="failed to get container status \"8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2\": rpc error: code = NotFound desc = could not find container \"8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2\": container with ID starting with 8ac023a49a8a8a598e3181363a24c4c3853099b1c24d63291229d4391aa9e3f2 not found: ID does not exist" Jun 11 10:01:17.322828 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.322805 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 10:01:17.351705 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.351678 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49c3360c-4547-4117-b461-924192976d8f-feast-data\") pod \"49c3360c-4547-4117-b461-924192976d8f\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " Jun 11 10:01:17.351934 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.351730 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-registry-tls\") pod \"49c3360c-4547-4117-b461-924192976d8f\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " Jun 11 10:01:17.351934 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.351776 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-online-tls\") pod \"49c3360c-4547-4117-b461-924192976d8f\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " Jun 11 10:01:17.352085 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.351922 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-offline-tls\") pod \"49c3360c-4547-4117-b461-924192976d8f\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " Jun 11 10:01:17.352085 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352059 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls\") pod \"49c3360c-4547-4117-b461-924192976d8f\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " Jun 11 10:01:17.352225 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352105 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wlcq\" (UniqueName: \"kubernetes.io/projected/49c3360c-4547-4117-b461-924192976d8f-kube-api-access-6wlcq\") pod \"49c3360c-4547-4117-b461-924192976d8f\" (UID: \"49c3360c-4547-4117-b461-924192976d8f\") " Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352352 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swxj2\" (UniqueName: \"kubernetes.io/projected/22e9de24-6994-40d2-bd2d-aa327d0a68d8-kube-api-access-swxj2\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352405 2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-online-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352418 2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-ui-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352430 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/22e9de24-6994-40d2-bd2d-aa327d0a68d8-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352442 2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/22e9de24-6994-40d2-bd2d-aa327d0a68d8-feast-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352454 2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/22e9de24-6994-40d2-bd2d-aa327d0a68d8-offline-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.352848 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.352350 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49c3360c-4547-4117-b461-924192976d8f-feast-data" (OuterVolumeSpecName: "feast-data") pod "49c3360c-4547-4117-b461-924192976d8f" (UID: "49c3360c-4547-4117-b461-924192976d8f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 10:01:17.354513 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.354483 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-online-tls" (OuterVolumeSpecName: "online-tls") pod "49c3360c-4547-4117-b461-924192976d8f" (UID: "49c3360c-4547-4117-b461-924192976d8f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.354662 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.354632 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49c3360c-4547-4117-b461-924192976d8f" (UID: "49c3360c-4547-4117-b461-924192976d8f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.354786 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.354693 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "49c3360c-4547-4117-b461-924192976d8f" (UID: "49c3360c-4547-4117-b461-924192976d8f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.355126 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.355105 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c3360c-4547-4117-b461-924192976d8f-kube-api-access-6wlcq" (OuterVolumeSpecName: "kube-api-access-6wlcq") pod "49c3360c-4547-4117-b461-924192976d8f" (UID: "49c3360c-4547-4117-b461-924192976d8f"). InnerVolumeSpecName "kube-api-access-6wlcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:01:17.355271 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.355251 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "49c3360c-4547-4117-b461-924192976d8f" (UID: "49c3360c-4547-4117-b461-924192976d8f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:01:17.452926 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.452894 2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-offline-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.452926 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.452923 2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-ui-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.452926 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.452932 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wlcq\" (UniqueName: \"kubernetes.io/projected/49c3360c-4547-4117-b461-924192976d8f-kube-api-access-6wlcq\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.453165 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.452940 2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/49c3360c-4547-4117-b461-924192976d8f-feast-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.453165 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.452948 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.453165 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.452956 2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/49c3360c-4547-4117-b461-924192976d8f-online-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:17.573777 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.573733 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6"] Jun 11 10:01:17.579859 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:17.579837 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-nl2v6"] Jun 11 10:01:18.259344 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.259306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" event={"ID":"49c3360c-4547-4117-b461-924192976d8f","Type":"ContainerDied","Data":"7498615fc705f11d48edd37d76606e3a4ab0b42f8ca5aa1a2db5a4d101dfbd03"} Jun 11 10:01:18.259742 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.259349 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds" Jun 11 10:01:18.259742 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.259361 2557 scope.go:117] "RemoveContainer" containerID="b43554938dbceea88f96b951738d2d20044eefc9f98178ef735ed04f40fc86c6" Jun 11 10:01:18.270187 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.270042 2557 scope.go:117] "RemoveContainer" containerID="fa25c719716b0bb106f4459e9a85494d47e977051d2ad6b43b61cf2dfd595e9e" Jun 11 10:01:18.277778 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.277746 2557 scope.go:117] "RemoveContainer" containerID="8bb15f46453640d9ed5471dfea542b024a42391edef65d924c5bd273cc04ce4e" Jun 11 10:01:18.285073 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.285053 2557 scope.go:117] "RemoveContainer" containerID="b8af18c57b62fd4e1eb55091ee37cc9e369dbc43f589e98583d458dc1946aae3" Jun 11 10:01:18.288811 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.288784 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds"] Jun 11 10:01:18.292871 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.292850 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-kctds"] Jun 11 10:01:18.293471 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.293454 2557 scope.go:117] "RemoveContainer" containerID="a59cbb3852ab483abc1ca51bdfc7620615d6797368bde6e8ebb7e9aa0489548f" Jun 11 10:01:18.300262 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:18.300247 2557 scope.go:117] "RemoveContainer" containerID="9904ad8e0dca313ebdd96de2bf04284e10cb86bd5bdf9ddf8b9312d76f999e0b" Jun 11 10:01:19.175673 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:19.175639 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" path="/var/lib/kubelet/pods/22e9de24-6994-40d2-bd2d-aa327d0a68d8/volumes" Jun 11 10:01:19.176222 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:19.176207 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c3360c-4547-4117-b461-924192976d8f" path="/var/lib/kubelet/pods/49c3360c-4547-4117-b461-924192976d8f/volumes" Jun 11 10:01:30.338147 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:30.338112 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:01:30.464366 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:30.464337 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:01:36.934621 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:36.934584 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:01:37.016647 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.016608 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:01:37.111208 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.111178 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j"] Jun 11 10:01:37.111391 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.111366 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" podUID="5a0c388f-bb16-4511-83e5-556fb250d869" containerName="manager" containerID="cri-o://543778f2d02425b3a78d2e3c05cce33c210a44ea5649640f39b495a1541c3337" gracePeriod=10 Jun 11 10:01:37.334777 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.334720 2557 generic.go:356] "Generic (PLEG): container finished" podID="5a0c388f-bb16-4511-83e5-556fb250d869" containerID="543778f2d02425b3a78d2e3c05cce33c210a44ea5649640f39b495a1541c3337" exitCode=0 Jun 11 10:01:37.334924 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.334798 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" event={"ID":"5a0c388f-bb16-4511-83e5-556fb250d869","Type":"ContainerDied","Data":"543778f2d02425b3a78d2e3c05cce33c210a44ea5649640f39b495a1541c3337"} Jun 11 10:01:37.352055 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.352033 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 10:01:37.479107 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.479010 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kctbf\" (UniqueName: \"kubernetes.io/projected/5a0c388f-bb16-4511-83e5-556fb250d869-kube-api-access-kctbf\") pod \"5a0c388f-bb16-4511-83e5-556fb250d869\" (UID: \"5a0c388f-bb16-4511-83e5-556fb250d869\") " Jun 11 10:01:37.481199 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.481171 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a0c388f-bb16-4511-83e5-556fb250d869-kube-api-access-kctbf" (OuterVolumeSpecName: "kube-api-access-kctbf") pod "5a0c388f-bb16-4511-83e5-556fb250d869" (UID: "5a0c388f-bb16-4511-83e5-556fb250d869"). InnerVolumeSpecName "kube-api-access-kctbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:01:37.579698 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:37.579662 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kctbf\" (UniqueName: \"kubernetes.io/projected/5a0c388f-bb16-4511-83e5-556fb250d869-kube-api-access-kctbf\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:01:38.339536 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:38.339499 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" event={"ID":"5a0c388f-bb16-4511-83e5-556fb250d869","Type":"ContainerDied","Data":"3c57de0bfaaec1c39f80059843e0688c49fa0859cb80732d6d1a3d50185eab04"} Jun 11 10:01:38.339966 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:38.339560 2557 scope.go:117] "RemoveContainer" containerID="543778f2d02425b3a78d2e3c05cce33c210a44ea5649640f39b495a1541c3337" Jun 11 10:01:38.339966 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:38.339510 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j" Jun 11 10:01:38.366992 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:38.366960 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j"] Jun 11 10:01:38.381922 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:38.381896 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-5wn7j"] Jun 11 10:01:39.174932 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:39.174902 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a0c388f-bb16-4511-83e5-556fb250d869" path="/var/lib/kubelet/pods/5a0c388f-bb16-4511-83e5-556fb250d869/volumes" Jun 11 10:01:42.212423 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212388 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r"] Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212652 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212663 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212675 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a0c388f-bb16-4511-83e5-556fb250d869" containerName="manager" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212682 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a0c388f-bb16-4511-83e5-556fb250d869" containerName="manager" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212691 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="offline" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212697 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="offline" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212703 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="feast-init" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212708 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="feast-init" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212714 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="feast-apply" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212719 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="feast-apply" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212725 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212730 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212737 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212742 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212748 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212753 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212774 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="offline" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212780 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="offline" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212786 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="feast-init" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212790 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="feast-init" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212795 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="registry" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212800 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="registry" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212810 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="feast-apply" Jun 11 10:01:42.212810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212815 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="feast-apply" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212856 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="online" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212863 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="offline" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212873 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="offline" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212878 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="ui" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212883 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a0c388f-bb16-4511-83e5-556fb250d869" containerName="manager" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212889 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="registry" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212893 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="22e9de24-6994-40d2-bd2d-aa327d0a68d8" containerName="online" Jun 11 10:01:42.213538 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.212899 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c3360c-4547-4117-b461-924192976d8f" containerName="ui" Jun 11 10:01:42.217089 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.217074 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:42.219872 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.219853 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jun 11 10:01:42.220769 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.220741 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-jvv4g\"" Jun 11 10:01:42.220884 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.220796 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jun 11 10:01:42.239595 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.239566 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r"] Jun 11 10:01:42.311346 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.311314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssht2\" (UniqueName: \"kubernetes.io/projected/9c822acd-4bfa-46d3-81d4-06b26d10e541-kube-api-access-ssht2\") pod \"feast-operator-controller-manager-6d54c7db9d-d8b4r\" (UID: \"9c822acd-4bfa-46d3-81d4-06b26d10e541\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:42.412129 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.412090 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssht2\" (UniqueName: \"kubernetes.io/projected/9c822acd-4bfa-46d3-81d4-06b26d10e541-kube-api-access-ssht2\") pod \"feast-operator-controller-manager-6d54c7db9d-d8b4r\" (UID: \"9c822acd-4bfa-46d3-81d4-06b26d10e541\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:42.429212 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.429180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssht2\" (UniqueName: \"kubernetes.io/projected/9c822acd-4bfa-46d3-81d4-06b26d10e541-kube-api-access-ssht2\") pod \"feast-operator-controller-manager-6d54c7db9d-d8b4r\" (UID: \"9c822acd-4bfa-46d3-81d4-06b26d10e541\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:42.527358 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.527274 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:42.679699 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:42.679667 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r"] Jun 11 10:01:42.683976 ip-10-0-137-96 kubenswrapper[2557]: W0611 10:01:42.683946 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c822acd_4bfa_46d3_81d4_06b26d10e541.slice/crio-cb6186feee87594c0940e068c23175627bb8ddeab122296617bd859152295e08 WatchSource:0}: Error finding container cb6186feee87594c0940e068c23175627bb8ddeab122296617bd859152295e08: Status 404 returned error can't find the container with id cb6186feee87594c0940e068c23175627bb8ddeab122296617bd859152295e08 Jun 11 10:01:43.361555 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:43.361519 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" event={"ID":"9c822acd-4bfa-46d3-81d4-06b26d10e541","Type":"ContainerStarted","Data":"df59191a71dccdefb95ac058d22b3e1dcbeb7be62ea1599584a8f9528a6d022b"} Jun 11 10:01:43.361555 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:43.361572 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" event={"ID":"9c822acd-4bfa-46d3-81d4-06b26d10e541","Type":"ContainerStarted","Data":"cb6186feee87594c0940e068c23175627bb8ddeab122296617bd859152295e08"} Jun 11 10:01:43.362040 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:43.361605 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:43.382282 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:43.382235 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" podStartSLOduration=1.382220157 podStartE2EDuration="1.382220157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:01:43.381581924 +0000 UTC m=+1630.632279513" watchObservedRunningTime="2026-06-11 10:01:43.382220157 +0000 UTC m=+1630.632917735" Jun 11 10:01:54.368900 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:54.368869 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-d8b4r" Jun 11 10:01:58.504107 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:58.504067 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:01:58.604265 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:01:58.604237 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:02:01.669997 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.669960 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:02:01.776471 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.776440 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:02:01.786540 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.786514 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g"] Jun 11 10:02:01.790108 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.790090 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.793595 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.793575 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jun 11 10:02:01.793698 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.793625 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jun 11 10:02:01.793938 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.793886 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jun 11 10:02:01.793938 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.793930 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-vgbwh\"" Jun 11 10:02:01.794086 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.793991 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jun 11 10:02:01.794086 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.794035 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jun 11 10:02:01.794420 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.794406 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jun 11 10:02:01.807416 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.807392 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g"] Jun 11 10:02:01.857696 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.857669 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.857696 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.857701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.857944 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.857725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f485bea-f70e-4923-91a6-12e77d78866e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.857944 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.857842 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.857944 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.857903 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.858050 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.857955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqq8\" (UniqueName: \"kubernetes.io/projected/5f485bea-f70e-4923-91a6-12e77d78866e-kube-api-access-lmqq8\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.869720 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.869679 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:02:01.959216 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.959216 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqq8\" (UniqueName: \"kubernetes.io/projected/5f485bea-f70e-4923-91a6-12e77d78866e-kube-api-access-lmqq8\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.959216 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959200 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.959483 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.959483 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f485bea-f70e-4923-91a6-12e77d78866e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.959483 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.959483 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:02:01.959439 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jun 11 10:02:01.959684 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:02:01.959521 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls podName:5f485bea-f70e-4923-91a6-12e77d78866e nodeName:}" failed. No retries permitted until 2026-06-11 10:02:02.45949867 +0000 UTC m=+1649.710196229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls") pod "feast-simple-feast-setup-75c64c888b-l6q8g" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e") : secret "feast-simple-feast-setup-offline-tls" not found Jun 11 10:02:01.959750 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.959686 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f485bea-f70e-4923-91a6-12e77d78866e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.961729 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.961704 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.961853 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.961729 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.961853 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.961748 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:01.970155 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.970128 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:02:01.971231 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:01.971207 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqq8\" (UniqueName: \"kubernetes.io/projected/5f485bea-f70e-4923-91a6-12e77d78866e-kube-api-access-lmqq8\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:02.191263 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:02.191224 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:02:02.464382 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:02.464345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:02.466789 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:02.466742 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-l6q8g\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:02.699403 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:02.699352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:02.837859 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:02.837828 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g"] Jun 11 10:02:02.839383 ip-10-0-137-96 kubenswrapper[2557]: W0611 10:02:02.839360 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f485bea_f70e_4923_91a6_12e77d78866e.slice/crio-465c5826cfc51d80398fb297d68896051229f02d76eebe3a655ac2031e93b1b7 WatchSource:0}: Error finding container 465c5826cfc51d80398fb297d68896051229f02d76eebe3a655ac2031e93b1b7: Status 404 returned error can't find the container with id 465c5826cfc51d80398fb297d68896051229f02d76eebe3a655ac2031e93b1b7 Jun 11 10:02:03.441650 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:03.441609 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef"} Jun 11 10:02:03.441872 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:03.441664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"465c5826cfc51d80398fb297d68896051229f02d76eebe3a655ac2031e93b1b7"} Jun 11 10:02:07.458176 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:07.458145 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f485bea-f70e-4923-91a6-12e77d78866e" containerID="1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef" exitCode=0 Jun 11 10:02:07.458501 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:07.458184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef"} Jun 11 10:02:08.464304 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:08.464266 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b"} Jun 11 10:02:13.485785 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:13.485724 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f485bea-f70e-4923-91a6-12e77d78866e" containerID="29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b" exitCode=0 Jun 11 10:02:13.486211 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:13.485790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b"} Jun 11 10:02:14.496091 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.496046 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a"} Jun 11 10:02:14.496579 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.496116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437"} Jun 11 10:02:14.496579 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.496141 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160"} Jun 11 10:02:14.496579 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.496159 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerStarted","Data":"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd"} Jun 11 10:02:14.526473 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.526385 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podStartSLOduration=13.526362533 podStartE2EDuration="13.526362533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:02:14.524054923 +0000 UTC m=+1661.774752503" watchObservedRunningTime="2026-06-11 10:02:14.526362533 +0000 UTC m=+1661.777060112" Jun 11 10:02:14.699991 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.699951 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:14.700188 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.700011 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:14.700188 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.700031 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:14.700188 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.700049 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:14.702040 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.702006 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Jun 11 10:02:14.702351 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.702011 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Jun 11 10:02:14.702351 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.702082 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 11 10:02:14.702549 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:14.702493 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Jun 11 10:02:17.699949 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:17.699903 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Jun 11 10:02:17.699949 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:17.699921 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Jun 11 10:02:17.700492 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:17.699898 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused" Jun 11 10:02:17.700691 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:17.700655 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 11 10:02:20.700983 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.700938 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.701417 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.701089 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.701417 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.701315 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.701779 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.701741 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.701962 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.701942 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.702057 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.701969 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.702057 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.702032 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.702155 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.702081 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.702213 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.702200 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:20.705664 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:20.705646 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:21.533199 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:21.533169 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:02:21.536143 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:02:21.536116 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:03:24.231154 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.231118 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:24.243133 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.243106 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g"] Jun 11 10:03:24.243353 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.243327 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="registry" containerID="cri-o://3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd" gracePeriod=30 Jun 11 10:03:24.243422 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.243379 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="offline" containerID="cri-o://b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437" gracePeriod=30 Jun 11 10:03:24.243546 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.243512 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" containerID="cri-o://7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160" gracePeriod=30 Jun 11 10:03:24.244258 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.243711 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" containerID="cri-o://55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a" gracePeriod=30 Jun 11 10:03:24.332160 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.332128 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:24.479205 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.479169 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:24.578429 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.578341 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:24.636427 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.636391 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8"] Jun 11 10:03:24.639894 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.639876 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.642813 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.642792 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gtqgl\"" Jun 11 10:03:24.659863 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.659832 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8"] Jun 11 10:03:24.705384 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.705358 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:24.743612 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.743570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2tnd\" (UniqueName: \"kubernetes.io/projected/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-kube-api-access-w2tnd\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.743810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.743630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.743810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.743665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.743810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.743698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.743810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.743728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.743810 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.743800 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.772234 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.772200 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f485bea-f70e-4923-91a6-12e77d78866e" containerID="55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a" exitCode=0 Jun 11 10:03:24.772390 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.772265 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a"} Jun 11 10:03:24.792370 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.792336 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:24.844438 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.844641 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2tnd\" (UniqueName: \"kubernetes.io/projected/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-kube-api-access-w2tnd\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.844641 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844506 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.844641 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.844641 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.844641 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.845067 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:24.844702 2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Jun 11 10:03:24.845067 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:24.844802 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls podName:cabf31ba-6125-486a-8c7c-f9f32d4ad5be nodeName:}" failed. No retries permitted until 2026-06-11 10:03:25.344742263 +0000 UTC m=+1732.595439823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls") pod "feast-simple-feast-setup-75c64c888b-8bhq8" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be") : secret "feast-simple-feast-setup-online-tls" not found Jun 11 10:03:24.845067 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.844903 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.847295 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.847244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.847416 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.847315 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.847416 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.847343 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.857986 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.857958 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2tnd\" (UniqueName: \"kubernetes.io/projected/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-kube-api-access-w2tnd\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:24.972711 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:24.972664 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:25.165866 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.165789 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:03:25.348562 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.348520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:25.351099 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.351071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-8bhq8\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:25.550875 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.550783 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:25.686805 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.686780 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8"] Jun 11 10:03:25.687690 ip-10-0-137-96 kubenswrapper[2557]: W0611 10:03:25.687661 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcabf31ba_6125_486a_8c7c_f9f32d4ad5be.slice/crio-3cb65dc3ff4d043ebbabca53e0bc518df6f36df147777f3d5a49f001b86eb4e6 WatchSource:0}: Error finding container 3cb65dc3ff4d043ebbabca53e0bc518df6f36df147777f3d5a49f001b86eb4e6: Status 404 returned error can't find the container with id 3cb65dc3ff4d043ebbabca53e0bc518df6f36df147777f3d5a49f001b86eb4e6 Jun 11 10:03:25.778583 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.778545 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"45c4a171092ceff2cc0567030d10e6248af37d53237e55453758520269d14bd1"} Jun 11 10:03:25.778721 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.778604 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"3cb65dc3ff4d043ebbabca53e0bc518df6f36df147777f3d5a49f001b86eb4e6"} Jun 11 10:03:25.781611 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.781588 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f485bea-f70e-4923-91a6-12e77d78866e" containerID="7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160" exitCode=0 Jun 11 10:03:25.781722 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:25.781620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160"} Jun 11 10:03:30.702819 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:30.702735 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Jun 11 10:03:30.805627 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:30.805589 2557 generic.go:356] "Generic (PLEG): container finished" podID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerID="45c4a171092ceff2cc0567030d10e6248af37d53237e55453758520269d14bd1" exitCode=0 Jun 11 10:03:30.805627 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:30.805629 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"45c4a171092ceff2cc0567030d10e6248af37d53237e55453758520269d14bd1"} Jun 11 10:03:31.533574 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:31.533533 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 11 10:03:31.812344 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:31.812264 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"bc604e05b65fd34ca8a742878071cc1e5e11de9e5586f679d1ca90877baddca7"} Jun 11 10:03:36.832435 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:36.832398 2557 generic.go:356] "Generic (PLEG): container finished" podID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerID="bc604e05b65fd34ca8a742878071cc1e5e11de9e5586f679d1ca90877baddca7" exitCode=0 Jun 11 10:03:36.832872 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:36.832466 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"bc604e05b65fd34ca8a742878071cc1e5e11de9e5586f679d1ca90877baddca7"} Jun 11 10:03:37.842140 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:37.842098 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"9106f77bcce2889b0f8521342b0a96c82fa151fe042480341695505b75e9fa6a"} Jun 11 10:03:37.842650 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:37.842168 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"bc2734142acb8b0ced8241ed1607faff0a6393bc413a5a9daee862df83c1c9d9"} Jun 11 10:03:37.842650 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:37.842190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"3555acb36ebc4dd01f519ec249e572614758a9c7ce68e7c2dce1fbab7bb146bd"} Jun 11 10:03:37.842650 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:37.842211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerStarted","Data":"4fe3528982832eabad2f900ca642e15a24bf494ca8e1369522a71de3df44e9c0"} Jun 11 10:03:37.882831 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:37.882742 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podStartSLOduration=13.882719256 podStartE2EDuration="13.882719256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:03:37.880812159 +0000 UTC m=+1745.131509739" watchObservedRunningTime="2026-06-11 10:03:37.882719256 +0000 UTC m=+1745.133416839" Jun 11 10:03:40.551714 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.551664 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:40.552206 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.551735 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:40.552206 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.551773 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:40.552206 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.551793 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:40.553661 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.553621 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused" Jun 11 10:03:40.553830 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.553676 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Jun 11 10:03:40.553830 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.553782 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 11 10:03:40.553830 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.553630 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused" Jun 11 10:03:40.702268 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:40.702223 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Jun 11 10:03:41.534368 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:41.534318 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 11 10:03:43.552773 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.552721 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.553249 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.552861 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.553249 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.553156 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.553919 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.553891 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.554053 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.553937 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.554053 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.553956 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.554053 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.554017 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.554219 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.554065 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.554219 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.554109 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.557942 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.557923 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.873991 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.873965 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:43.877039 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:43.877020 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:03:50.702292 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:50.702239 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Jun 11 10:03:50.702789 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:50.702381 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:03:51.533561 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:51.533512 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Jun 11 10:03:51.533783 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:51.533650 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:03:54.889723 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.889694 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:03:54.902531 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.902509 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-registry-tls\") pod \"5f485bea-f70e-4923-91a6-12e77d78866e\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " Jun 11 10:03:54.902652 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.902548 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmqq8\" (UniqueName: \"kubernetes.io/projected/5f485bea-f70e-4923-91a6-12e77d78866e-kube-api-access-lmqq8\") pod \"5f485bea-f70e-4923-91a6-12e77d78866e\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " Jun 11 10:03:54.902652 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.902573 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f485bea-f70e-4923-91a6-12e77d78866e-feast-data\") pod \"5f485bea-f70e-4923-91a6-12e77d78866e\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " Jun 11 10:03:54.902652 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.902623 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls\") pod \"5f485bea-f70e-4923-91a6-12e77d78866e\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " Jun 11 10:03:54.902851 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.902656 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-ui-tls\") pod \"5f485bea-f70e-4923-91a6-12e77d78866e\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " Jun 11 10:03:54.902851 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.902681 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-online-tls\") pod \"5f485bea-f70e-4923-91a6-12e77d78866e\" (UID: \"5f485bea-f70e-4923-91a6-12e77d78866e\") " Jun 11 10:03:54.903207 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.903170 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f485bea-f70e-4923-91a6-12e77d78866e-feast-data" (OuterVolumeSpecName: "feast-data") pod "5f485bea-f70e-4923-91a6-12e77d78866e" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 10:03:54.904939 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.904895 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-online-tls" (OuterVolumeSpecName: "online-tls") pod "5f485bea-f70e-4923-91a6-12e77d78866e" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:03:54.905045 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.904930 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5f485bea-f70e-4923-91a6-12e77d78866e" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:03:54.905045 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.904981 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f485bea-f70e-4923-91a6-12e77d78866e-kube-api-access-lmqq8" (OuterVolumeSpecName: "kube-api-access-lmqq8") pod "5f485bea-f70e-4923-91a6-12e77d78866e" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e"). InnerVolumeSpecName "kube-api-access-lmqq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:03:54.905139 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.905055 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5f485bea-f70e-4923-91a6-12e77d78866e" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:03:54.905216 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.905148 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5f485bea-f70e-4923-91a6-12e77d78866e" (UID: "5f485bea-f70e-4923-91a6-12e77d78866e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:03:54.918878 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.918848 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f485bea-f70e-4923-91a6-12e77d78866e" containerID="b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437" exitCode=137 Jun 11 10:03:54.918878 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.918878 2557 generic.go:356] "Generic (PLEG): container finished" podID="5f485bea-f70e-4923-91a6-12e77d78866e" containerID="3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd" exitCode=137 Jun 11 10:03:54.919028 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.918923 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" Jun 11 10:03:54.919028 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.918927 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437"} Jun 11 10:03:54.919028 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.918974 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd"} Jun 11 10:03:54.919028 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.918989 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g" event={"ID":"5f485bea-f70e-4923-91a6-12e77d78866e","Type":"ContainerDied","Data":"465c5826cfc51d80398fb297d68896051229f02d76eebe3a655ac2031e93b1b7"} Jun 11 10:03:54.919028 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.919008 2557 scope.go:117] "RemoveContainer" containerID="55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a" Jun 11 10:03:54.929745 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.929726 2557 scope.go:117] "RemoveContainer" containerID="b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437" Jun 11 10:03:54.938690 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.938666 2557 scope.go:117] "RemoveContainer" containerID="7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160" Jun 11 10:03:54.947051 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.947032 2557 scope.go:117] "RemoveContainer" containerID="3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd" Jun 11 10:03:54.954807 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.954780 2557 scope.go:117] "RemoveContainer" containerID="29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b" Jun 11 10:03:54.962091 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.962072 2557 scope.go:117] "RemoveContainer" containerID="1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef" Jun 11 10:03:54.966190 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.966165 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g"] Jun 11 10:03:54.969621 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.969600 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-l6q8g"] Jun 11 10:03:54.970812 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.970796 2557 scope.go:117] "RemoveContainer" containerID="55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a" Jun 11 10:03:54.971065 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:54.971046 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a\": container with ID starting with 55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a not found: ID does not exist" containerID="55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a" Jun 11 10:03:54.971116 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971073 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a"} err="failed to get container status \"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a\": rpc error: code = NotFound desc = could not find container \"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a\": container with ID starting with 55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a not found: ID does not exist" Jun 11 10:03:54.971116 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971093 2557 scope.go:117] "RemoveContainer" containerID="b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437" Jun 11 10:03:54.971322 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:54.971299 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437\": container with ID starting with b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437 not found: ID does not exist" containerID="b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437" Jun 11 10:03:54.971363 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971332 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437"} err="failed to get container status \"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437\": rpc error: code = NotFound desc = could not find container \"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437\": container with ID starting with b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437 not found: ID does not exist" Jun 11 10:03:54.971363 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971349 2557 scope.go:117] "RemoveContainer" containerID="7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160" Jun 11 10:03:54.971603 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:54.971583 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160\": container with ID starting with 7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160 not found: ID does not exist" containerID="7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160" Jun 11 10:03:54.971664 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971608 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160"} err="failed to get container status \"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160\": rpc error: code = NotFound desc = could not find container \"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160\": container with ID starting with 7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160 not found: ID does not exist" Jun 11 10:03:54.971664 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971624 2557 scope.go:117] "RemoveContainer" containerID="3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd" Jun 11 10:03:54.971924 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:54.971903 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd\": container with ID starting with 3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd not found: ID does not exist" containerID="3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd" Jun 11 10:03:54.972005 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971932 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd"} err="failed to get container status \"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd\": rpc error: code = NotFound desc = could not find container \"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd\": container with ID starting with 3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd not found: ID does not exist" Jun 11 10:03:54.972005 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.971956 2557 scope.go:117] "RemoveContainer" containerID="29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b" Jun 11 10:03:54.972211 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:54.972193 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b\": container with ID starting with 29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b not found: ID does not exist" containerID="29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b" Jun 11 10:03:54.972251 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.972217 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b"} err="failed to get container status \"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b\": rpc error: code = NotFound desc = could not find container \"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b\": container with ID starting with 29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b not found: ID does not exist" Jun 11 10:03:54.972251 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.972234 2557 scope.go:117] "RemoveContainer" containerID="1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef" Jun 11 10:03:54.972463 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:03:54.972446 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef\": container with ID starting with 1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef not found: ID does not exist" containerID="1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef" Jun 11 10:03:54.972503 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.972476 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef"} err="failed to get container status \"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef\": rpc error: code = NotFound desc = could not find container \"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef\": container with ID starting with 1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef not found: ID does not exist" Jun 11 10:03:54.972503 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.972491 2557 scope.go:117] "RemoveContainer" containerID="55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a" Jun 11 10:03:54.972747 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.972723 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a"} err="failed to get container status \"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a\": rpc error: code = NotFound desc = could not find container \"55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a\": container with ID starting with 55ebf266a722be41ab7067d050555ccf64c67b0f830630f9afe66292daf3ad4a not found: ID does not exist" Jun 11 10:03:54.972828 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.972748 2557 scope.go:117] "RemoveContainer" containerID="b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437" Jun 11 10:03:54.973024 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973006 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437"} err="failed to get container status \"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437\": rpc error: code = NotFound desc = could not find container \"b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437\": container with ID starting with b6ad59bbddd8c9eaf5fa3177123258e191547a2a70997c6dd66c44d29b559437 not found: ID does not exist" Jun 11 10:03:54.973071 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973024 2557 scope.go:117] "RemoveContainer" containerID="7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160" Jun 11 10:03:54.973231 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973214 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160"} err="failed to get container status \"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160\": rpc error: code = NotFound desc = could not find container \"7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160\": container with ID starting with 7303f873dba354ef1080efabd6e601d3c0a89e2b80886576570cb43806d31160 not found: ID does not exist" Jun 11 10:03:54.973281 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973232 2557 scope.go:117] "RemoveContainer" containerID="3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd" Jun 11 10:03:54.973455 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973439 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd"} err="failed to get container status \"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd\": rpc error: code = NotFound desc = could not find container \"3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd\": container with ID starting with 3885b2b13a37b457b9a7c5fc51e846b73459af3f5a001e063838a95eb930b3cd not found: ID does not exist" Jun 11 10:03:54.973503 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973456 2557 scope.go:117] "RemoveContainer" containerID="29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b" Jun 11 10:03:54.973651 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973636 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b"} err="failed to get container status \"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b\": rpc error: code = NotFound desc = could not find container \"29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b\": container with ID starting with 29c390ed2b07dffeba3071725832c2ff57dc9812759c3e36d163531da21f2b7b not found: ID does not exist" Jun 11 10:03:54.973697 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973652 2557 scope.go:117] "RemoveContainer" containerID="1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef" Jun 11 10:03:54.973857 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:54.973839 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef"} err="failed to get container status \"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef\": rpc error: code = NotFound desc = could not find container \"1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef\": container with ID starting with 1fc99f0aa22273baee7234f9645c6ba035ea39ea4a0c86c34631527c8a05ecef not found: ID does not exist" Jun 11 10:03:55.003407 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.003378 2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-offline-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:03:55.003407 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.003405 2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-ui-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:03:55.003407 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.003413 2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-online-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:03:55.003610 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.003422 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5f485bea-f70e-4923-91a6-12e77d78866e-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:03:55.003610 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.003430 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmqq8\" (UniqueName: \"kubernetes.io/projected/5f485bea-f70e-4923-91a6-12e77d78866e-kube-api-access-lmqq8\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:03:55.003610 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.003440 2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f485bea-f70e-4923-91a6-12e77d78866e-feast-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:03:55.175952 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:03:55.175921 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" path="/var/lib/kubelet/pods/5f485bea-f70e-4923-91a6-12e77d78866e/volumes" Jun 11 10:04:09.866782 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:09.866723 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:45.651496 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:45.651461 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:45.753324 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:45.753287 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:45.920881 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:45.920802 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:46.023555 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.023522 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:46.037542 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037513 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws"] Jun 11 10:04:46.037836 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037823 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="registry" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037838 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="registry" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037850 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037856 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037865 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037870 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037880 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="feast-apply" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037885 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="feast-apply" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037890 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="feast-init" Jun 11 10:04:46.037896 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037895 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="feast-init" Jun 11 10:04:46.038197 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037910 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="offline" Jun 11 10:04:46.038197 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037915 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="offline" Jun 11 10:04:46.038197 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037961 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="online" Jun 11 10:04:46.038197 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037969 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="ui" Jun 11 10:04:46.038197 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037974 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="registry" Jun 11 10:04:46.038197 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.037981 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f485bea-f70e-4923-91a6-12e77d78866e" containerName="offline" Jun 11 10:04:46.042432 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.042413 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.045120 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.045097 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jun 11 10:04:46.045226 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.045108 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-lslvn\"" Jun 11 10:04:46.046238 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.046219 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jun 11 10:04:46.046822 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.046808 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jun 11 10:04:46.047240 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.047208 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jun 11 10:04:46.047339 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.047215 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jun 11 10:04:46.047339 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.047283 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jun 11 10:04:46.060469 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.060446 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws"] Jun 11 10:04:46.110983 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.110948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.111161 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.111016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znt9j\" (UniqueName: \"kubernetes.io/projected/ce50c996-9906-4f10-aa9b-77ce5e759b30-kube-api-access-znt9j\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.111161 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.111048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce50c996-9906-4f10-aa9b-77ce5e759b30-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.111161 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.111079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ce50c996-9906-4f10-aa9b-77ce5e759b30-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.111161 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.111102 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.111161 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.111128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.120644 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.120607 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:46.212291 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212201 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znt9j\" (UniqueName: \"kubernetes.io/projected/ce50c996-9906-4f10-aa9b-77ce5e759b30-kube-api-access-znt9j\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.212459 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce50c996-9906-4f10-aa9b-77ce5e759b30-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.212459 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212347 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ce50c996-9906-4f10-aa9b-77ce5e759b30-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.212459 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212374 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.212459 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212406 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.212698 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212477 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.212792 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.212724 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce50c996-9906-4f10-aa9b-77ce5e759b30-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.213134 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.213113 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ce50c996-9906-4f10-aa9b-77ce5e759b30-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.215050 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.215022 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.215144 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.215050 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.215144 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.215046 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.222040 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.222012 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:04:46.222518 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.222498 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znt9j\" (UniqueName: \"kubernetes.io/projected/ce50c996-9906-4f10-aa9b-77ce5e759b30-kube-api-access-znt9j\") pod \"feast-simple-feast-remote-setup-669bcf45fc-rb4ws\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.351539 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.351495 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:46.487699 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:46.487670 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws"] Jun 11 10:04:46.489973 ip-10-0-137-96 kubenswrapper[2557]: W0611 10:04:46.489945 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce50c996_9906_4f10_aa9b_77ce5e759b30.slice/crio-d72c0841b6d7a0cd53cc52c4e4485ebd4b5ccffe7d41944e3412acc844b2257b WatchSource:0}: Error finding container d72c0841b6d7a0cd53cc52c4e4485ebd4b5ccffe7d41944e3412acc844b2257b: Status 404 returned error can't find the container with id d72c0841b6d7a0cd53cc52c4e4485ebd4b5ccffe7d41944e3412acc844b2257b Jun 11 10:04:47.118894 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:47.118854 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerStarted","Data":"dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb"} Jun 11 10:04:47.119355 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:47.118906 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerStarted","Data":"d72c0841b6d7a0cd53cc52c4e4485ebd4b5ccffe7d41944e3412acc844b2257b"} Jun 11 10:04:51.137144 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:51.137108 2557 generic.go:356] "Generic (PLEG): container finished" podID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerID="dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb" exitCode=0 Jun 11 10:04:51.137527 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:51.137183 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerDied","Data":"dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb"} Jun 11 10:04:52.143289 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:52.143255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerStarted","Data":"c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f"} Jun 11 10:04:57.165724 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:57.165690 2557 generic.go:356] "Generic (PLEG): container finished" podID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerID="c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f" exitCode=0 Jun 11 10:04:57.166152 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:57.165777 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerDied","Data":"c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f"} Jun 11 10:04:58.174604 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.174559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerStarted","Data":"0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1"} Jun 11 10:04:58.174998 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.174627 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerStarted","Data":"bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96"} Jun 11 10:04:58.174998 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.174647 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerStarted","Data":"3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c"} Jun 11 10:04:58.206050 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.205987 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podStartSLOduration=12.205970067 podStartE2EDuration="12.205970067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:04:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:04:58.204712967 +0000 UTC m=+1825.455410545" watchObservedRunningTime="2026-06-11 10:04:58.205970067 +0000 UTC m=+1825.456667645" Jun 11 10:04:58.352529 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.352442 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:58.352529 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.352518 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:58.352735 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.352539 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:04:58.354187 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.354145 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Jun 11 10:04:58.354187 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.354167 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Jun 11 10:04:58.354375 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:04:58.354188 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Jun 11 10:05:01.352143 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:01.352090 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Jun 11 10:05:01.352531 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:01.352091 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Jun 11 10:05:01.352531 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:01.352092 2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Jun 11 10:05:04.353639 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.353604 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:04.354063 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.353815 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:04.354221 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.354178 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:04.354315 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.354233 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:04.354601 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.354578 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:04.354697 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.354684 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:04.357770 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:04.357738 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:05.207775 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:05.207721 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:05:05.210696 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:05:05.210670 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:06:07.031815 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.031779 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:07.043340 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.043315 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws"] Jun 11 10:06:07.043563 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.043528 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" containerID="cri-o://3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c" gracePeriod=30 Jun 11 10:06:07.043661 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.043547 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" containerID="cri-o://0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1" gracePeriod=30 Jun 11 10:06:07.043661 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.043614 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="offline" containerID="cri-o://bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96" gracePeriod=30 Jun 11 10:06:07.184664 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.184625 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8"] Jun 11 10:06:07.184928 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.184877 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="registry" containerID="cri-o://4fe3528982832eabad2f900ca642e15a24bf494ca8e1369522a71de3df44e9c0" gracePeriod=30 Jun 11 10:06:07.185123 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.184918 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="offline" containerID="cri-o://bc2734142acb8b0ced8241ed1607faff0a6393bc413a5a9daee862df83c1c9d9" gracePeriod=30 Jun 11 10:06:07.185247 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.184964 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" containerID="cri-o://9106f77bcce2889b0f8521342b0a96c82fa151fe042480341695505b75e9fa6a" gracePeriod=30 Jun 11 10:06:07.185313 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:07.185195 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" containerID="cri-o://3555acb36ebc4dd01f519ec249e572614758a9c7ce68e7c2dce1fbab7bb146bd" gracePeriod=30 Jun 11 10:06:08.171505 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.171416 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:08.457490 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.457401 2557 generic.go:356] "Generic (PLEG): container finished" podID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerID="9106f77bcce2889b0f8521342b0a96c82fa151fe042480341695505b75e9fa6a" exitCode=0 Jun 11 10:06:08.457490 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.457426 2557 generic.go:356] "Generic (PLEG): container finished" podID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerID="3555acb36ebc4dd01f519ec249e572614758a9c7ce68e7c2dce1fbab7bb146bd" exitCode=0 Jun 11 10:06:08.457490 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.457473 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"9106f77bcce2889b0f8521342b0a96c82fa151fe042480341695505b75e9fa6a"} Jun 11 10:06:08.457726 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.457525 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"3555acb36ebc4dd01f519ec249e572614758a9c7ce68e7c2dce1fbab7bb146bd"} Jun 11 10:06:08.459982 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.459961 2557 generic.go:356] "Generic (PLEG): container finished" podID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerID="0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1" exitCode=0 Jun 11 10:06:08.459982 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.459978 2557 generic.go:356] "Generic (PLEG): container finished" podID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerID="3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c" exitCode=0 Jun 11 10:06:08.460137 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.460017 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerDied","Data":"0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1"} Jun 11 10:06:08.460137 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:08.460042 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerDied","Data":"3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c"} Jun 11 10:06:12.344141 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:12.344103 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:13.553988 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:13.553931 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Jun 11 10:06:13.874558 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:13.874515 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 11 10:06:14.355048 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:14.355003 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Jun 11 10:06:15.208163 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:15.208123 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Jun 11 10:06:23.554653 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:23.554598 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Jun 11 10:06:23.874453 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:23.874410 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 11 10:06:24.354460 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:24.354413 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Jun 11 10:06:25.208653 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:25.208599 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Jun 11 10:06:33.554298 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:33.554252 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused" Jun 11 10:06:33.554733 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:33.554441 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:06:33.874680 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:33.874637 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused" Jun 11 10:06:33.874887 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:33.874786 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:06:34.354373 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:34.354322 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused" Jun 11 10:06:34.354566 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:34.354476 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:06:35.207881 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:35.207842 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Jun 11 10:06:35.208331 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:35.207961 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:06:37.285131 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.285101 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:06:37.359663 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.359625 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-offline-tls\") pod \"ce50c996-9906-4f10-aa9b-77ce5e759b30\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " Jun 11 10:06:37.359887 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.359679 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ce50c996-9906-4f10-aa9b-77ce5e759b30-registry-tls\") pod \"ce50c996-9906-4f10-aa9b-77ce5e759b30\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " Jun 11 10:06:37.359887 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.359709 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-ui-tls\") pod \"ce50c996-9906-4f10-aa9b-77ce5e759b30\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " Jun 11 10:06:37.359887 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.359730 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce50c996-9906-4f10-aa9b-77ce5e759b30-feast-data\") pod \"ce50c996-9906-4f10-aa9b-77ce5e759b30\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " Jun 11 10:06:37.359887 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.359786 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-online-tls\") pod \"ce50c996-9906-4f10-aa9b-77ce5e759b30\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " Jun 11 10:06:37.359887 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.359861 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znt9j\" (UniqueName: \"kubernetes.io/projected/ce50c996-9906-4f10-aa9b-77ce5e759b30-kube-api-access-znt9j\") pod \"ce50c996-9906-4f10-aa9b-77ce5e759b30\" (UID: \"ce50c996-9906-4f10-aa9b-77ce5e759b30\") " Jun 11 10:06:37.360172 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.360143 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce50c996-9906-4f10-aa9b-77ce5e759b30-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce50c996-9906-4f10-aa9b-77ce5e759b30" (UID: "ce50c996-9906-4f10-aa9b-77ce5e759b30"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 10:06:37.360312 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.360282 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce50c996-9906-4f10-aa9b-77ce5e759b30-feast-data" (OuterVolumeSpecName: "feast-data") pod "ce50c996-9906-4f10-aa9b-77ce5e759b30" (UID: "ce50c996-9906-4f10-aa9b-77ce5e759b30"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 10:06:37.362120 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.362084 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-online-tls" (OuterVolumeSpecName: "online-tls") pod "ce50c996-9906-4f10-aa9b-77ce5e759b30" (UID: "ce50c996-9906-4f10-aa9b-77ce5e759b30"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.362234 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.362152 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce50c996-9906-4f10-aa9b-77ce5e759b30-kube-api-access-znt9j" (OuterVolumeSpecName: "kube-api-access-znt9j") pod "ce50c996-9906-4f10-aa9b-77ce5e759b30" (UID: "ce50c996-9906-4f10-aa9b-77ce5e759b30"). InnerVolumeSpecName "kube-api-access-znt9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:06:37.362234 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.362227 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ce50c996-9906-4f10-aa9b-77ce5e759b30" (UID: "ce50c996-9906-4f10-aa9b-77ce5e759b30"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.362311 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.362242 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ce50c996-9906-4f10-aa9b-77ce5e759b30" (UID: "ce50c996-9906-4f10-aa9b-77ce5e759b30"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.460881 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.460842 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znt9j\" (UniqueName: \"kubernetes.io/projected/ce50c996-9906-4f10-aa9b-77ce5e759b30-kube-api-access-znt9j\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.460881 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.460875 2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-offline-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.460881 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.460886 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ce50c996-9906-4f10-aa9b-77ce5e759b30-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.461110 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.460897 2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-ui-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.461110 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.460906 2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce50c996-9906-4f10-aa9b-77ce5e759b30-feast-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.461110 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.460914 2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce50c996-9906-4f10-aa9b-77ce5e759b30-online-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.584773 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.584736 2557 generic.go:356] "Generic (PLEG): container finished" podID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerID="bc2734142acb8b0ced8241ed1607faff0a6393bc413a5a9daee862df83c1c9d9" exitCode=137 Jun 11 10:06:37.584773 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.584778 2557 generic.go:356] "Generic (PLEG): container finished" podID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerID="4fe3528982832eabad2f900ca642e15a24bf494ca8e1369522a71de3df44e9c0" exitCode=137 Jun 11 10:06:37.584989 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.584785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"bc2734142acb8b0ced8241ed1607faff0a6393bc413a5a9daee862df83c1c9d9"} Jun 11 10:06:37.584989 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.584825 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"4fe3528982832eabad2f900ca642e15a24bf494ca8e1369522a71de3df44e9c0"} Jun 11 10:06:37.587086 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.587061 2557 generic.go:356] "Generic (PLEG): container finished" podID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerID="bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96" exitCode=137 Jun 11 10:06:37.587203 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.587124 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerDied","Data":"bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96"} Jun 11 10:06:37.587203 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.587136 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" Jun 11 10:06:37.587203 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.587153 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws" event={"ID":"ce50c996-9906-4f10-aa9b-77ce5e759b30","Type":"ContainerDied","Data":"d72c0841b6d7a0cd53cc52c4e4485ebd4b5ccffe7d41944e3412acc844b2257b"} Jun 11 10:06:37.587203 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.587173 2557 scope.go:117] "RemoveContainer" containerID="0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1" Jun 11 10:06:37.595997 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.595978 2557 scope.go:117] "RemoveContainer" containerID="bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96" Jun 11 10:06:37.603676 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.603655 2557 scope.go:117] "RemoveContainer" containerID="3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c" Jun 11 10:06:37.613185 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.613112 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws"] Jun 11 10:06:37.613575 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.613551 2557 scope.go:117] "RemoveContainer" containerID="c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f" Jun 11 10:06:37.621836 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.621809 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-rb4ws"] Jun 11 10:06:37.622101 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.622086 2557 scope.go:117] "RemoveContainer" containerID="dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb" Jun 11 10:06:37.629340 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.629322 2557 scope.go:117] "RemoveContainer" containerID="0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1" Jun 11 10:06:37.629602 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:06:37.629583 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1\": container with ID starting with 0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1 not found: ID does not exist" containerID="0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1" Jun 11 10:06:37.629650 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.629611 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1"} err="failed to get container status \"0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1\": rpc error: code = NotFound desc = could not find container \"0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1\": container with ID starting with 0b6244a73dbde04145e5ec34829c49b9e647c8dceaaad674ab7686f41d1845b1 not found: ID does not exist" Jun 11 10:06:37.629650 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.629636 2557 scope.go:117] "RemoveContainer" containerID="bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96" Jun 11 10:06:37.629898 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:06:37.629879 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96\": container with ID starting with bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96 not found: ID does not exist" containerID="bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96" Jun 11 10:06:37.629947 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.629906 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96"} err="failed to get container status \"bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96\": rpc error: code = NotFound desc = could not find container \"bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96\": container with ID starting with bca7d82c8e4473c1e8e4d8202e655c48b48a303d8efe69a4780f96eb5bffef96 not found: ID does not exist" Jun 11 10:06:37.629947 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.629922 2557 scope.go:117] "RemoveContainer" containerID="3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c" Jun 11 10:06:37.630164 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:06:37.630145 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c\": container with ID starting with 3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c not found: ID does not exist" containerID="3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c" Jun 11 10:06:37.630214 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.630169 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c"} err="failed to get container status \"3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c\": rpc error: code = NotFound desc = could not find container \"3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c\": container with ID starting with 3d25311b213f9cdde09800686d1ab4a6d4c464b7c44234a27af2375175516a9c not found: ID does not exist" Jun 11 10:06:37.630214 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.630184 2557 scope.go:117] "RemoveContainer" containerID="c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f" Jun 11 10:06:37.630428 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:06:37.630410 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f\": container with ID starting with c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f not found: ID does not exist" containerID="c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f" Jun 11 10:06:37.630469 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.630434 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f"} err="failed to get container status \"c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f\": rpc error: code = NotFound desc = could not find container \"c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f\": container with ID starting with c57715032b6188577c10c3e4a6f7922fd3e457b460363a2ac94ddb9c289d319f not found: ID does not exist" Jun 11 10:06:37.630469 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.630446 2557 scope.go:117] "RemoveContainer" containerID="dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb" Jun 11 10:06:37.630671 ip-10-0-137-96 kubenswrapper[2557]: E0611 10:06:37.630654 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb\": container with ID starting with dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb not found: ID does not exist" containerID="dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb" Jun 11 10:06:37.630708 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.630676 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb"} err="failed to get container status \"dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb\": rpc error: code = NotFound desc = could not find container \"dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb\": container with ID starting with dc523bb2567dba16ce9af4f5d8bd41360f1b22e198ebf7586cfcfdc36b1c50fb not found: ID does not exist" Jun 11 10:06:37.828687 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.828660 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:06:37.864879 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.864794 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-feast-data\") pod \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " Jun 11 10:06:37.864879 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.864830 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls\") pod \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " Jun 11 10:06:37.864879 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.864869 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2tnd\" (UniqueName: \"kubernetes.io/projected/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-kube-api-access-w2tnd\") pod \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " Jun 11 10:06:37.865158 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.864893 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-ui-tls\") pod \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " Jun 11 10:06:37.865158 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.864908 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-registry-tls\") pod \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " Jun 11 10:06:37.865158 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.864936 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-offline-tls\") pod \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\" (UID: \"cabf31ba-6125-486a-8c7c-f9f32d4ad5be\") " Jun 11 10:06:37.865404 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.865374 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-feast-data" (OuterVolumeSpecName: "feast-data") pod "cabf31ba-6125-486a-8c7c-f9f32d4ad5be" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 10:06:37.867120 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.867095 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cabf31ba-6125-486a-8c7c-f9f32d4ad5be" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.867229 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.867126 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls" (OuterVolumeSpecName: "online-tls") pod "cabf31ba-6125-486a-8c7c-f9f32d4ad5be" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.867409 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.867390 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "cabf31ba-6125-486a-8c7c-f9f32d4ad5be" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.867464 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.867408 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-kube-api-access-w2tnd" (OuterVolumeSpecName: "kube-api-access-w2tnd") pod "cabf31ba-6125-486a-8c7c-f9f32d4ad5be" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be"). InnerVolumeSpecName "kube-api-access-w2tnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 10:06:37.867464 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.867426 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "cabf31ba-6125-486a-8c7c-f9f32d4ad5be" (UID: "cabf31ba-6125-486a-8c7c-f9f32d4ad5be"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 10:06:37.965932 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.965893 2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-online-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.965932 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.965924 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2tnd\" (UniqueName: \"kubernetes.io/projected/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-kube-api-access-w2tnd\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.965932 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.965935 2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-ui-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.965932 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.965944 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-registry-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.966199 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.965952 2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-offline-tls\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:37.966199 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:37.965959 2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cabf31ba-6125-486a-8c7c-f9f32d4ad5be-feast-data\") on node \"ip-10-0-137-96.ec2.internal\" DevicePath \"\"" Jun 11 10:06:38.593811 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.593779 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" Jun 11 10:06:38.594251 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.593783 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8" event={"ID":"cabf31ba-6125-486a-8c7c-f9f32d4ad5be","Type":"ContainerDied","Data":"3cb65dc3ff4d043ebbabca53e0bc518df6f36df147777f3d5a49f001b86eb4e6"} Jun 11 10:06:38.594251 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.593909 2557 scope.go:117] "RemoveContainer" containerID="9106f77bcce2889b0f8521342b0a96c82fa151fe042480341695505b75e9fa6a" Jun 11 10:06:38.603341 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.603323 2557 scope.go:117] "RemoveContainer" containerID="bc2734142acb8b0ced8241ed1607faff0a6393bc413a5a9daee862df83c1c9d9" Jun 11 10:06:38.610589 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.610571 2557 scope.go:117] "RemoveContainer" containerID="3555acb36ebc4dd01f519ec249e572614758a9c7ce68e7c2dce1fbab7bb146bd" Jun 11 10:06:38.617600 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.617582 2557 scope.go:117] "RemoveContainer" containerID="4fe3528982832eabad2f900ca642e15a24bf494ca8e1369522a71de3df44e9c0" Jun 11 10:06:38.623608 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.623585 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8"] Jun 11 10:06:38.625093 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.625076 2557 scope.go:117] "RemoveContainer" containerID="bc604e05b65fd34ca8a742878071cc1e5e11de9e5586f679d1ca90877baddca7" Jun 11 10:06:38.629808 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.629745 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-8bhq8"] Jun 11 10:06:38.632416 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:38.632404 2557 scope.go:117] "RemoveContainer" containerID="45c4a171092ceff2cc0567030d10e6248af37d53237e55453758520269d14bd1" Jun 11 10:06:39.176066 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:39.176032 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" path="/var/lib/kubelet/pods/cabf31ba-6125-486a-8c7c-f9f32d4ad5be/volumes" Jun 11 10:06:39.176698 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:39.176684 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" path="/var/lib/kubelet/pods/ce50c996-9906-4f10-aa9b-77ce5e759b30/volumes" Jun 11 10:06:50.791943 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:50.791904 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:50.892942 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:50.892910 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:51.028908 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:51.028879 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:51.129396 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:51.129359 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:54.469127 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:54.469094 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:54.535584 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:54.535555 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:57.257633 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:57.257598 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:57.327697 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:57.327663 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:59.198864 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:59.198814 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:06:59.292930 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:06:59.292875 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:07:16.448484 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.448403 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:07:16.608645 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.608589 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:07:16.609136 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609112 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r8hw7/must-gather-djf6q"] Jun 11 10:07:16.609388 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609376 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" Jun 11 10:07:16.609425 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609389 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" Jun 11 10:07:16.609425 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609400 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="feast-apply" Jun 11 10:07:16.609425 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609406 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="feast-apply" Jun 11 10:07:16.609425 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609413 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="offline" Jun 11 10:07:16.609425 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609419 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="offline" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609427 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="registry" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609432 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="registry" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609438 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="feast-init" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609444 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="feast-init" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609450 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="offline" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609454 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="offline" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609460 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609465 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609473 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609478 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609482 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="feast-apply" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609487 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="feast-apply" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609493 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="feast-init" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609498 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="feast-init" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609503 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609508 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609552 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="online" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609559 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="ui" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609566 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="offline" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609572 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabf31ba-6125-486a-8c7c-f9f32d4ad5be" containerName="registry" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609578 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="online" Jun 11 10:07:16.609580 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609584 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="offline" Jun 11 10:07:16.610490 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.609590 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce50c996-9906-4f10-aa9b-77ce5e759b30" containerName="ui" Jun 11 10:07:16.612349 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.612333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.614566 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.614538 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r8hw7\"/\"default-dockercfg-s89st\"" Jun 11 10:07:16.614691 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.614614 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r8hw7\"/\"kube-root-ca.crt\"" Jun 11 10:07:16.614691 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.614682 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r8hw7\"/\"openshift-service-ca.crt\"" Jun 11 10:07:16.623532 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.623510 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r8hw7/must-gather-djf6q"] Jun 11 10:07:16.681585 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.681555 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:07:16.775188 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.775098 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7ea0ef5-05a4-420e-9730-5fe0f76877d2-must-gather-output\") pod \"must-gather-djf6q\" (UID: \"b7ea0ef5-05a4-420e-9730-5fe0f76877d2\") " pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.775188 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.775133 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbqtx\" (UniqueName: \"kubernetes.io/projected/b7ea0ef5-05a4-420e-9730-5fe0f76877d2-kube-api-access-rbqtx\") pod \"must-gather-djf6q\" (UID: \"b7ea0ef5-05a4-420e-9730-5fe0f76877d2\") " pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.876426 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.876385 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7ea0ef5-05a4-420e-9730-5fe0f76877d2-must-gather-output\") pod \"must-gather-djf6q\" (UID: \"b7ea0ef5-05a4-420e-9730-5fe0f76877d2\") " pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.876627 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.876434 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqtx\" (UniqueName: \"kubernetes.io/projected/b7ea0ef5-05a4-420e-9730-5fe0f76877d2-kube-api-access-rbqtx\") pod \"must-gather-djf6q\" (UID: \"b7ea0ef5-05a4-420e-9730-5fe0f76877d2\") " pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.876803 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.876782 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7ea0ef5-05a4-420e-9730-5fe0f76877d2-must-gather-output\") pod \"must-gather-djf6q\" (UID: \"b7ea0ef5-05a4-420e-9730-5fe0f76877d2\") " pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.885833 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.885812 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbqtx\" (UniqueName: \"kubernetes.io/projected/b7ea0ef5-05a4-420e-9730-5fe0f76877d2-kube-api-access-rbqtx\") pod \"must-gather-djf6q\" (UID: \"b7ea0ef5-05a4-420e-9730-5fe0f76877d2\") " pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:16.920742 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:16.920714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r8hw7/must-gather-djf6q" Jun 11 10:07:17.062657 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:17.062631 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r8hw7/must-gather-djf6q"] Jun 11 10:07:17.064984 ip-10-0-137-96 kubenswrapper[2557]: W0611 10:07:17.064947 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7ea0ef5_05a4_420e_9730_5fe0f76877d2.slice/crio-d459144cbf6b9e43a8607f5fd0c1e00abdcba39446239b9832dfd2a6546552c5 WatchSource:0}: Error finding container d459144cbf6b9e43a8607f5fd0c1e00abdcba39446239b9832dfd2a6546552c5: Status 404 returned error can't find the container with id d459144cbf6b9e43a8607f5fd0c1e00abdcba39446239b9832dfd2a6546552c5 Jun 11 10:07:17.066753 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:17.066738 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 10:07:17.741665 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:17.741623 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/must-gather-djf6q" event={"ID":"b7ea0ef5-05a4-420e-9730-5fe0f76877d2","Type":"ContainerStarted","Data":"d459144cbf6b9e43a8607f5fd0c1e00abdcba39446239b9832dfd2a6546552c5"} Jun 11 10:07:18.747912 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:18.747875 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/must-gather-djf6q" event={"ID":"b7ea0ef5-05a4-420e-9730-5fe0f76877d2","Type":"ContainerStarted","Data":"77090164a4ad7d7ec1634c94cf979771eef88663dc89c38527b9ca750851ef02"} Jun 11 10:07:18.748386 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:18.747923 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/must-gather-djf6q" event={"ID":"b7ea0ef5-05a4-420e-9730-5fe0f76877d2","Type":"ContainerStarted","Data":"94906ab15399a54a2183965465ea365b6f3abcf22fece6b99936a237d8cb1571"} Jun 11 10:07:18.767367 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:18.767296 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r8hw7/must-gather-djf6q" podStartSLOduration=1.90102149 podStartE2EDuration="2.767279304s" totalImagesPullingTime="866.257814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 10:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:18.766485316 +0000 UTC m=+1966.017182919" watchObservedRunningTime="2026-06-11 10:07:18.767279304 +0000 UTC m=+1966.017976882" Jun 11 10:07:19.532890 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:19.532863 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rjddd_47ca36d9-6678-40e0-bdb9-82b77f074535/global-pull-secret-syncer/0.log" Jun 11 10:07:19.640104 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:19.640059 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" Jun 11 10:07:19.766772 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:19.766732 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-96.ec2.internal_7e3975a94ce874e15a33ae15093f7df3/haproxy/0.log" Jun 11 10:07:22.412690 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:22.412653 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:07:22.483957 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:22.483878 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-47hlh_3c137833-44bc-44d4-af02-8abe248d768b/konnectivity-agent/0.log" limit=1024 Jun 11 10:07:23.728806 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:23.728753 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-k7gd4_7d161574-c5b5-4505-b2d2-0bf56323937e/cluster-monitoring-operator/0.log" Jun 11 10:07:23.873174 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:23.873141 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-t784m_a847e3fc-3f8a-42d9-b095-96130025ee07/monitoring-plugin/0.log" Jun 11 10:07:24.087528 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.087453 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbjnp_371e910d-ee33-468e-841c-8e186880f136/node-exporter/0.log" Jun 11 10:07:24.115489 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.115453 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbjnp_371e910d-ee33-468e-841c-8e186880f136/kube-rbac-proxy/0.log" Jun 11 10:07:24.143001 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.142969 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rbjnp_371e910d-ee33-468e-841c-8e186880f136/init-textfile/0.log" Jun 11 10:07:24.750043 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.750013 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/thanos-query/0.log" Jun 11 10:07:24.780572 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.780537 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy-web/0.log" Jun 11 10:07:24.808408 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.808380 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy/0.log" Jun 11 10:07:24.837534 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.837505 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/prom-label-proxy/0.log" Jun 11 10:07:24.869879 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.869805 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy-rules/0.log" Jun 11 10:07:24.903396 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:24.903367 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75bc84d886-q5jk9_f42aa9a0-e0ef-4cb0-a3c1-bee429e493bf/kube-rbac-proxy-metrics/0.log" Jun 11 10:07:26.043798 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.043743 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-rlq5l_152671bc-056d-48aa-af5a-03ab6b2be264/networking-console-plugin/0.log" Jun 11 10:07:26.665166 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.665103 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b"] Jun 11 10:07:26.670076 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.670042 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.680984 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.680957 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b"] Jun 11 10:07:26.761603 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.761563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-proc\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.761941 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.761897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-lib-modules\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.762111 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.762093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-sys\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.762274 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.762260 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-podres\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.762409 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.762396 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2tz2\" (UniqueName: \"kubernetes.io/projected/e0311e45-fdf4-4d99-9547-74300d6e2199-kube-api-access-k2tz2\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863150 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-podres\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863597 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2tz2\" (UniqueName: \"kubernetes.io/projected/e0311e45-fdf4-4d99-9547-74300d6e2199-kube-api-access-k2tz2\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863881 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-proc\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863982 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-lib-modules\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863982 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863500 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-podres\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863982 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-sys\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.863982 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.863970 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-sys\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.864190 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.864067 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-proc\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.864190 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.864141 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e0311e45-fdf4-4d99-9547-74300d6e2199-lib-modules\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.873488 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.873461 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2tz2\" (UniqueName: \"kubernetes.io/projected/e0311e45-fdf4-4d99-9547-74300d6e2199-kube-api-access-k2tz2\") pod \"perf-node-gather-daemonset-6fz2b\" (UID: \"e0311e45-fdf4-4d99-9547-74300d6e2199\") " pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.983293 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.983201 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:26.998571 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:26.998543 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bc59f6849-7rx7g_3695c669-5915-4228-9aec-c57aeffeea57/console/0.log" Jun 11 10:07:27.151325 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:27.151290 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b"] Jun 11 10:07:27.154268 ip-10-0-137-96 kubenswrapper[2557]: W0611 10:07:27.154239 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode0311e45_fdf4_4d99_9547_74300d6e2199.slice/crio-d778a56de93ac0b3bfe2f47aceb443026e3a4805ab5de9535e250e7e4dd55683 WatchSource:0}: Error finding container d778a56de93ac0b3bfe2f47aceb443026e3a4805ab5de9535e250e7e4dd55683: Status 404 returned error can't find the container with id d778a56de93ac0b3bfe2f47aceb443026e3a4805ab5de9535e250e7e4dd55683 Jun 11 10:07:27.797829 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:27.797790 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" event={"ID":"e0311e45-fdf4-4d99-9547-74300d6e2199","Type":"ContainerStarted","Data":"4057a10a48a8645be0ea543af0d8b91037f57b089abe4c3462d47a899f51b678"} Jun 11 10:07:27.798004 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:27.797852 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" event={"ID":"e0311e45-fdf4-4d99-9547-74300d6e2199","Type":"ContainerStarted","Data":"d778a56de93ac0b3bfe2f47aceb443026e3a4805ab5de9535e250e7e4dd55683"} Jun 11 10:07:27.798004 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:27.797916 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:28.400901 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:28.400867 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jjjr_909b7c22-55ba-428c-b4fd-78e1f23b3268/dns/0.log" Jun 11 10:07:28.430433 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:28.430403 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jjjr_909b7c22-55ba-428c-b4fd-78e1f23b3268/kube-rbac-proxy/0.log" Jun 11 10:07:28.566417 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:28.566389 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c2dfw_c65cf062-90d4-41de-a2e1-6be061576475/dns-node-resolver/0.log" Jun 11 10:07:29.125530 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:29.125492 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5dhcg_8d87c275-3b60-46a1-ae16-8b8a83a371bc/node-ca/0.log" Jun 11 10:07:30.509399 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:30.509373 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjrrn_6f71ddba-ddd0-4c68-8627-c16833b90bb1/serve-healthcheck-canary/0.log" Jun 11 10:07:30.896656 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:30.896626 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-2fc2c_70493004-c3b5-4e1d-98a1-e9fc96e6bb5d/insights-operator/0.log" Jun 11 10:07:30.898753 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:30.898731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-2fc2c_70493004-c3b5-4e1d-98a1-e9fc96e6bb5d/insights-operator/1.log" Jun 11 10:07:30.923555 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:30.923528 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fbdt_44b71a94-7494-4f88-afc1-d50bf47cfc1b/kube-rbac-proxy/0.log" Jun 11 10:07:30.948448 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:30.948421 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fbdt_44b71a94-7494-4f88-afc1-d50bf47cfc1b/exporter/0.log" Jun 11 10:07:30.975583 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:30.975558 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6fbdt_44b71a94-7494-4f88-afc1-d50bf47cfc1b/extractor/0.log" Jun 11 10:07:33.814724 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:33.814697 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" Jun 11 10:07:33.831578 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:33.831526 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r8hw7/perf-node-gather-daemonset-6fz2b" podStartSLOduration=7.831509106 podStartE2EDuration="7.831509106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 10:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 10:07:27.816988542 +0000 UTC m=+1975.067686121" watchObservedRunningTime="2026-06-11 10:07:33.831509106 +0000 UTC m=+1981.082206684" Jun 11 10:07:36.440349 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:36.440314 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wr7lb_a71d589c-fbf5-4a15-a09b-b5288750948a/kube-storage-version-migrator-operator/1.log" Jun 11 10:07:36.441452 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:36.441315 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wr7lb_a71d589c-fbf5-4a15-a09b-b5288750948a/kube-storage-version-migrator-operator/0.log" Jun 11 10:07:37.836537 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:37.836504 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/kube-multus-additional-cni-plugins/0.log" Jun 11 10:07:37.886053 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:37.886021 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/egress-router-binary-copy/0.log" Jun 11 10:07:37.929663 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:37.929635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/cni-plugins/0.log" Jun 11 10:07:37.957173 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:37.957149 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/bond-cni-plugin/0.log" Jun 11 10:07:37.989545 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:37.989518 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/routeoverride-cni/0.log" Jun 11 10:07:38.017291 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:38.017209 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/whereabouts-cni-bincopy/0.log" Jun 11 10:07:38.043941 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:38.043906 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h44sc_aad8dd33-47b2-44a8-a6ad-50cf8e8a0316/whereabouts-cni/0.log" Jun 11 10:07:38.114238 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:38.114211 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mr5s7_f20681de-fd57-4b00-93b0-1f58c1dc6868/kube-multus/0.log" Jun 11 10:07:38.223356 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:38.223327 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lcnlh_b4f19fec-d824-439a-9722-e2af866a4010/network-metrics-daemon/0.log" Jun 11 10:07:38.251716 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:38.251688 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lcnlh_b4f19fec-d824-439a-9722-e2af866a4010/kube-rbac-proxy/0.log" Jun 11 10:07:39.655117 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.655087 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/ovn-controller/0.log" Jun 11 10:07:39.682215 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.682184 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/ovn-acl-logging/0.log" Jun 11 10:07:39.714335 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.714304 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/kube-rbac-proxy-node/0.log" Jun 11 10:07:39.754227 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.754201 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 10:07:39.777593 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.777562 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/northd/0.log" Jun 11 10:07:39.815413 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.815385 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/nbdb/0.log" Jun 11 10:07:39.843447 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.843414 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/sbdb/0.log" Jun 11 10:07:39.896461 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:39.896429 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jcpx7_4d57e6e7-b860-418b-bd61-b36fb2dacedb/ovnkube-controller/0.log" Jun 11 10:07:41.101651 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:41.101622 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-bm5wj_cd74cd07-e117-43c8-8414-934fd561832a/check-endpoints/0.log" Jun 11 10:07:41.170778 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:41.170725 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fzf96_cf5a331e-9396-4059-aeaf-61c462327270/network-check-target-container/0.log" Jun 11 10:07:42.435323 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:42.435294 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ksjxk_28ae5677-a4b3-45d0-ad63-57ce72ec178e/iptables-alerter/0.log" Jun 11 10:07:43.334516 ip-10-0-137-96 kubenswrapper[2557]: I0611 10:07:43.334432 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tz9wb_b1ef8a4a-32f6-42a1-86d1-b3922d550a13/tuned/0.log"