Sep 08 08:47:34.407568 ip-10-0-132-205 systemd[1]: Starting Kubernetes Kubelet... Sep 08 08:47:34.842796 ip-10-0-132-205 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 08:47:34.842796 ip-10-0-132-205 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 08:47:34.842796 ip-10-0-132-205 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 08:47:34.842796 ip-10-0-132-205 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 08:47:34.842796 ip-10-0-132-205 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 08:47:34.845052 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.844894 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849383 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849438 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849445 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849452 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849457 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849462 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849467 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849473 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849478 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849483 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:47:34.849455 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849488 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849492 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849497 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849501 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849505 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849514 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849522 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849526 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849532 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849536 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849553 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849558 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849563 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849567 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849571 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849576 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849580 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849585 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849589 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:47:34.850217 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849595 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849603 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849609 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849614 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849617 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849624 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849627 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849632 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849636 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849640 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849644 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849648 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849652 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849655 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849659 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849666 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849670 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849675 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849679 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:47:34.851007 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849683 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849692 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849697 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849702 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849707 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849713 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849718 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849724 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849728 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849733 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849738 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849743 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849748 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849753 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849758 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849767 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849774 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849781 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849784 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:47:34.851836 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849790 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849796 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849800 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849805 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849811 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849816 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849820 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849825 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849829 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849837 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849842 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849848 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849853 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849858 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849863 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849868 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849874 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849879 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.849884 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850017 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:47:34.852437 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850384 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850397 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850403 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850409 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850415 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850421 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850427 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850432 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850451 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850456 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850461 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.850467 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852179 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852218 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852222 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852225 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852228 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852232 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852235 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:47:34.852972 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852238 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852241 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852244 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852247 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852250 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852253 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852256 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852258 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852261 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852264 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852267 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852269 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852273 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852286 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852290 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852293 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852296 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852299 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852302 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852305 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:47:34.853513 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852308 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852311 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852314 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852317 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852319 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852324 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852329 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852332 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852335 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852338 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852340 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852343 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852345 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852348 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852350 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852353 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852356 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852358 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852361 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:47:34.854034 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852363 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852366 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852368 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852371 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852374 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852376 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852379 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852381 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852384 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852387 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852390 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852393 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852395 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852398 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852400 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852403 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852405 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852408 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852410 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852414 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:47:34.854586 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852417 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852419 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852422 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852425 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852427 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852430 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852433 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852435 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852438 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852441 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852443 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852447 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852451 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852453 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852456 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852459 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852467 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852470 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852473 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852475 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:47:34.855115 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852478 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852480 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852483 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852486 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852488 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852491 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852494 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852497 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852499 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852502 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852505 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852509 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.852513 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853006 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853014 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853018 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853021 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853024 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853027 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:47:34.855663 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853030 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853033 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853035 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853038 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853041 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853044 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853047 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853049 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853052 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853054 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853058 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853060 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853063 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853066 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853069 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853072 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853075 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853078 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853080 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853083 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:47:34.856204 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853085 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853088 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853090 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853093 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853096 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853099 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853102 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853105 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853107 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853110 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853114 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853116 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853119 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853122 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853124 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853127 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853129 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853132 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853135 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:47:34.856727 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853138 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853141 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853143 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853146 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853149 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853151 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853154 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853156 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853161 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853165 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853167 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853170 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853173 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853175 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853178 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853180 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853197 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853202 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853206 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:47:34.857232 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853209 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853211 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853214 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853217 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853221 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853226 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853229 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853232 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853235 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853238 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853240 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853243 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853246 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853250 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853253 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853255 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853258 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853261 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853264 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853266 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:47:34.857770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853269 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853272 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853275 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853277 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853280 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853283 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853286 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853288 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853291 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853296 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853300 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853303 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853305 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853308 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.853311 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853408 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853469 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853478 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853485 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853489 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853493 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 08:47:34.858314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853498 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853502 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853506 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853509 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853513 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853516 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853520 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853523 2561 flags.go:64] FLAG: --cgroup-root="" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853526 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853529 2561 flags.go:64] FLAG: --client-ca-file="" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853533 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853536 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853540 2561 flags.go:64] FLAG: --cluster-domain="" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853543 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853546 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853549 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853553 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853556 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853559 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853563 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853567 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853570 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853574 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853577 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 08:47:34.858863 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853580 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853584 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853591 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853594 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853597 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853600 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853604 2561 flags.go:64] FLAG: --enable-server="true" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853608 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853613 2561 flags.go:64] FLAG: --event-burst="100" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853617 2561 flags.go:64] FLAG: --event-qps="50" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853620 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853623 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853626 2561 flags.go:64] FLAG: --eviction-hard="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853630 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853633 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853636 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853639 2561 flags.go:64] FLAG: --eviction-soft="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853642 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853646 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853649 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853651 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853654 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853657 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853660 2561 flags.go:64] FLAG: --feature-gates="" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853664 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 08:47:34.859579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853667 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853670 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853673 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853678 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853681 2561 flags.go:64] FLAG: --help="false" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853685 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-205.ec2.internal" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853688 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853691 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853695 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853698 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853701 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853704 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853708 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853711 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853715 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853718 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853721 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853724 2561 flags.go:64] FLAG: --kube-reserved="" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853727 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853730 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853733 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853736 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853739 2561 flags.go:64] FLAG: --lock-file="" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853742 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 08:47:34.860262 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853745 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853748 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853754 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853757 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853760 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853763 2561 flags.go:64] FLAG: --logging-format="text" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853766 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853770 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853772 2561 flags.go:64] FLAG: --manifest-url="" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853775 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853782 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853786 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853791 2561 flags.go:64] FLAG: --max-pods="110" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853794 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853797 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853800 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853803 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853806 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853809 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853813 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853821 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853824 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853828 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 08:47:34.860901 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853832 2561 flags.go:64] FLAG: --pod-cidr="" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853835 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853842 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853845 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853849 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853852 2561 flags.go:64] FLAG: --port="10250" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853856 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853859 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00116c95f49815ded" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853863 2561 flags.go:64] FLAG: --qos-reserved="" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853866 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853870 2561 flags.go:64] FLAG: --register-node="true" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853872 2561 flags.go:64] FLAG: --register-with-taints="" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853880 2561 flags.go:64] FLAG: --registry-burst="10" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853883 2561 flags.go:64] FLAG: --registry-qps="5" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853887 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853890 2561 flags.go:64] FLAG: --reserved-memory="" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853894 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853897 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853901 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853904 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853907 2561 flags.go:64] FLAG: --runonce="false" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853910 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853914 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853917 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853920 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 08:47:34.861530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853923 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853926 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853929 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853933 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853936 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853939 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853942 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853945 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853949 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853952 2561 flags.go:64] FLAG: --system-cgroups="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853955 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853961 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853964 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853967 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853971 2561 flags.go:64] FLAG: --tls-min-version="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853974 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853977 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853980 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853983 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853988 2561 flags.go:64] FLAG: --v="2" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853993 2561 flags.go:64] FLAG: --version="false" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.853997 2561 flags.go:64] FLAG: --vmodule="" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.854001 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.854006 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854170 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:47:34.862210 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854177 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854199 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854208 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854213 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854217 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854220 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854224 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854228 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854231 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854234 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854238 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854242 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854244 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854248 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854252 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854255 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854260 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854263 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854265 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854268 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:47:34.862902 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854272 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854275 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854277 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854280 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854283 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854288 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854294 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854298 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854300 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854303 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854308 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854311 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854313 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854316 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854319 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854322 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854325 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854328 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854330 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854333 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:47:34.863522 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854336 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854339 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854342 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854344 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854348 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854351 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854355 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854358 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854361 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854365 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854368 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854371 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854373 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854376 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854378 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854381 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854384 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854387 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854391 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:47:34.864036 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854408 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854412 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854414 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854418 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854421 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854424 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854426 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854429 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854432 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854446 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854453 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854456 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854459 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854462 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854466 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854471 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854473 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854476 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854479 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:47:34.864553 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854481 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854484 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854487 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854490 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854494 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854498 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854501 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854503 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854506 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854509 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854511 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854514 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854519 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854521 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854524 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854526 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854531 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854534 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854536 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:47:34.865050 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.854539 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.854550 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.863360 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.863392 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.864287 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.864298 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864372 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864378 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864384 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864387 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864390 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864393 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864396 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864399 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864401 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:47:34.865579 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864404 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864407 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864409 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864412 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864415 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864418 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864421 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864423 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864426 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864429 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864433 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864435 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864438 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864440 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864443 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864445 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864448 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864451 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864454 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864458 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:47:34.865990 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864462 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864465 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864467 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864470 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864473 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864476 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864479 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864482 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864484 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864487 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864490 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864492 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864495 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864497 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864500 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864503 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864506 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864510 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864515 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864518 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:47:34.866538 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864521 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864523 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864527 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864530 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864532 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864535 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864538 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864541 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864543 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864546 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864550 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864554 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864557 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864561 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864564 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864567 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864570 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864573 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864575 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864578 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:47:34.867090 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864581 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864584 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864586 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864589 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864592 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864595 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864598 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864601 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864604 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864607 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864609 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864614 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864618 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864621 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864624 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864627 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864630 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864633 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864635 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:47:34.867628 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864638 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864642 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864646 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864649 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864652 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864655 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864658 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864663 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864667 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864671 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864674 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.864680 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864808 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864812 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 08:47:34.868110 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864815 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864818 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864821 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864824 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864827 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864830 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864832 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864835 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864837 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864840 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864843 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864846 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864849 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864852 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864855 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864857 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864860 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864863 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864865 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 08:47:34.868500 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864868 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864871 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864873 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864877 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864880 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864884 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864887 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864899 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864903 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864906 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864909 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864913 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864917 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864922 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864926 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864929 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864932 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864936 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864939 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 08:47:34.869033 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864942 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864944 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864947 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864950 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864953 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864956 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864958 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864961 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864964 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864968 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864971 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864974 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864977 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864980 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864983 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864986 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864989 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864992 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864996 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.864998 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 08:47:34.869643 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865001 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865005 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865008 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865010 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865013 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865015 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865018 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865020 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865023 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865025 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865028 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865030 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865033 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865035 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865038 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865041 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865044 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865046 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865049 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865052 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 08:47:34.870138 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865055 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865057 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865060 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865063 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865065 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865068 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865071 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865073 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865077 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865080 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865083 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865085 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865088 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865090 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865093 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865097 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865099 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865102 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 08:47:34.870669 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:34.865104 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 08:47:34.871152 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.865110 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 08:47:34.871152 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.865288 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 08:47:34.871152 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.868010 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 08:47:34.871152 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.869166 2561 server.go:1019] "Starting client certificate rotation" Sep 08 08:47:34.871152 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.869307 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 08:47:34.871152 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.869345 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 08:47:34.872251 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.872230 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 08:47:34.874677 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.874629 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 08:47:34.887231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.887206 2561 log.go:25] "Validated CRI v1 runtime API" Sep 08 08:47:34.891457 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.891424 2561 log.go:25] "Validated CRI v1 image API" Sep 08 08:47:34.893522 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.893492 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 08:47:34.897174 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.897146 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e378aec6-08ef-4548-b685-1ceccc37e6bb:/dev/nvme0n1p3 ff3a88ce-369d-488f-bfb6-01a9e1d5d845:/dev/nvme0n1p4] Sep 08 08:47:34.897280 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.897171 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 08:47:34.900962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.900925 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 08:47:34.903980 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.903802 2561 manager.go:216] Machine: {Timestamp:2026-09-08 08:47:34.902346623 +0000 UTC m=+0.377360797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100383 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a017a3e2af7657669b6e55059b17a SystemUUID:ec2a017a-3e2a-f765-7669-b6e55059b17a BootID:59a35b70-c0b5-43a4-8bf2-0dab9d0a2d74 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:59:c7:8d:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:59:c7:8d:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:ed:4f:e4:02:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 08:47:34.903980 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.903953 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 08:47:34.904252 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.904115 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 08:47:34.908071 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.908023 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 08:47:34.908261 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.908074 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 08:47:34.908989 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.908975 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 08:47:34.909040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.908991 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 08:47:34.909040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.909000 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 08:47:34.909884 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.909869 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 08:47:34.911127 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.911112 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 08:47:34.916024 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916003 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 08 08:47:34.916178 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916168 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 08:47:34.916244 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916214 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 08 08:47:34.916244 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916224 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 08:47:34.916244 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916237 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 08:47:34.916360 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916247 2561 kubelet.go:398] "Adding apiserver pod source" Sep 08 08:47:34.916360 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916258 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 08:47:34.916769 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916754 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 08:47:34.916809 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.916780 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 08:47:34.919506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.919460 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 08:47:34.922897 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.922870 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 08:47:34.923034 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.922910 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 08:47:34.924479 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924457 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 08:47:34.924479 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924481 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924487 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924493 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924505 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924514 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924530 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924536 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924544 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924550 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924560 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 08:47:34.924641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.924566 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 08:47:34.926515 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.926493 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 08:47:34.926629 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.926526 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 08:47:34.926629 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.926531 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 08:47:34.926629 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.926516 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 08:47:34.931072 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.930823 2561 server.go:1268] "Started kubelet" Sep 08 08:47:34.931240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.930898 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 08:47:34.931443 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.931378 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 08:47:34.931510 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.931477 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 08:47:34.932388 ip-10-0-132-205 systemd[1]: Started Kubernetes Kubelet. Sep 08 08:47:34.933067 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.932997 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 08:47:34.933157 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.933087 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 08 08:47:34.935235 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.935214 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 08:47:34.936910 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.935725 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-205.ec2.internal.18d34c32120796a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-205.ec2.internal,UID:ip-10-0-132-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-205.ec2.internal,},FirstTimestamp:2026-09-08 08:47:34.930781856 +0000 UTC m=+0.405796086,LastTimestamp:2026-09-08 08:47:34.930781856 +0000 UTC m=+0.405796086,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-205.ec2.internal,}" Sep 08 08:47:34.937225 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.937204 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 08:47:34.940324 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.940293 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 08:47:34.941051 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.941027 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 08:47:34.941246 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.941222 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:34.941916 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.941866 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 08:47:34.941916 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.941881 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 08:47:34.941916 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.941888 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 08:47:34.942094 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942021 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 08 08:47:34.942094 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942031 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 08 08:47:34.942094 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942056 2561 factory.go:55] Registering systemd factory Sep 08 08:47:34.942094 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942073 2561 factory.go:223] Registration of the systemd container factory successfully Sep 08 08:47:34.942346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942332 2561 factory.go:153] Registering CRI-O factory Sep 08 08:47:34.942407 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942348 2561 factory.go:223] Registration of the crio container factory successfully Sep 08 08:47:34.942459 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942408 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 08:47:34.942667 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942644 2561 factory.go:103] Registering Raw factory Sep 08 08:47:34.942725 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.942683 2561 manager.go:1196] Started watching for new ooms in manager Sep 08 08:47:34.943267 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.943251 2561 manager.go:349] Starting recovery of all containers Sep 08 08:47:34.952899 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.952859 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 08:47:34.952899 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.952864 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 08:47:34.956278 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.956252 2561 manager.go:354] Recovery completed Sep 08 08:47:34.960477 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.960453 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hs7pn" Sep 08 08:47:34.961538 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.961522 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:34.964469 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.964443 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:34.964566 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.964484 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:34.964566 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.964497 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:34.965126 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.965107 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 08:47:34.965126 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.965122 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:34.965304 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.965125 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 08:47:34.965304 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.965225 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 08 08:47:34.966013 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.965994 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:34.966064 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.966037 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:34.966064 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.966055 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:34.967513 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.967500 2561 policy_none.go:49] "None policy: Start" Sep 08 08:47:34.967570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.967519 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 08:47:34.967570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.967530 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 08:47:34.968806 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.968786 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hs7pn" Sep 08 08:47:34.970140 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:34.970118 2561 policy_none.go:47] "Start" Sep 08 08:47:34.973531 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:34.973379 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-205.ec2.internal.18d34c3214099509 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-205.ec2.internal,UID:ip-10-0-132-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-205.ec2.internal,},FirstTimestamp:2026-09-08 08:47:34.964466953 +0000 UTC m=+0.439481127,LastTimestamp:2026-09-08 08:47:34.964466953 +0000 UTC m=+0.439481127,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-205.ec2.internal,}" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.017422 2561 manager.go:337] "Starting Device Plugin manager" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.017472 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.017483 2561 server.go:87] "Starting device plugin registration server" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.017902 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.017973 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.018076 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.018168 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.018179 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.018833 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 08:47:35.022904 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.018879 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.047884 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.047836 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 08:47:35.049287 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.049268 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 08:47:35.049410 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.049330 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 08:47:35.049410 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.049358 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 08:47:35.049410 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.049399 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 08:47:35.052064 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.052034 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:47:35.118617 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.118492 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:35.119545 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.119523 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:35.119621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.119565 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:35.119621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.119576 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:35.119621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.119609 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.128136 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.128108 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.128227 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.128147 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-205.ec2.internal\": node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.143864 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.143832 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.149844 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.149806 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"] Sep 08 08:47:35.149939 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.149929 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:35.151584 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.151564 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:35.151690 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.151599 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:35.151690 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.151616 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:35.154057 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.154036 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:35.154329 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.154310 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.154408 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.154347 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:35.155039 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.155018 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:35.155125 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.155063 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:35.155125 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.155074 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:35.155429 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.155414 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:35.155484 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.155442 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:35.155484 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.155453 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:35.157662 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.157640 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.157764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.157679 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:35.158598 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.158580 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:35.158706 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.158614 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:35.158706 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.158634 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:35.181346 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.181313 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-205.ec2.internal\" not found" node="ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.186245 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.186225 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-205.ec2.internal\" not found" node="ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.243277 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.243248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.243277 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.243280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eaef65e55aa5f7053cfe7a3a8e382309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-205.ec2.internal\" (UID: \"eaef65e55aa5f7053cfe7a3a8e382309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.243490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.243300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.244036 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.244015 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.344165 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.344114 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.344387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.344211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.344387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.344249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.344387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.344271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eaef65e55aa5f7053cfe7a3a8e382309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-205.ec2.internal\" (UID: \"eaef65e55aa5f7053cfe7a3a8e382309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.344387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.344330 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.344387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.344343 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eaef65e55aa5f7053cfe7a3a8e382309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-205.ec2.internal\" (UID: \"eaef65e55aa5f7053cfe7a3a8e382309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.344387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.344330 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.445070 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.444980 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.484232 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.484181 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.490357 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.490333 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" Sep 08 08:47:35.545996 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.545946 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.646496 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.646451 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.747036 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.746947 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.816099 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.816067 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:47:35.847670 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.847633 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.869877 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.869841 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 08:47:35.870025 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.870007 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 08:47:35.870066 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.870038 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 08:47:35.947730 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:35.947696 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:35.975794 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.975743 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 08:42:36 +0000 UTC" deadline="2028-06-09 00:43:36.83480098 +0000 UTC" Sep 08 08:47:35.975794 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:35.975785 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15351h56m0.859020638s" Sep 08 08:47:36.011858 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.011762 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:47:36.048072 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:36.048039 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:36.130460 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.130420 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 08:47:36.131848 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.131823 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory" Sep 08 08:47:36.131964 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.131860 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 08:47:36.131964 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.131871 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID" Sep 08 08:47:36.144367 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:36.144335 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaef65e55aa5f7053cfe7a3a8e382309.slice/crio-b3963057ca543711e02d2b81de3117194dd09bad738bb33faa7a3f755dfb4c07 WatchSource:0}: Error finding container b3963057ca543711e02d2b81de3117194dd09bad738bb33faa7a3f755dfb4c07: Status 404 returned error can't find the container with id b3963057ca543711e02d2b81de3117194dd09bad738bb33faa7a3f755dfb4c07 Sep 08 08:47:36.148153 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:36.148135 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:36.150179 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.150161 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:47:36.248461 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:36.248426 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found" Sep 08 08:47:36.336446 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.336370 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:47:36.342078 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.342042 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" Sep 08 08:47:36.352323 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.352293 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 08:47:36.353360 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.353341 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" Sep 08 08:47:36.362362 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.362341 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 08:47:36.403992 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:36.403966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356d70d76887b88988d30ee1a1b2cbfb.slice/crio-24861db986d6c8c87deb43a53a4316ef162d10c360c66a1519d0882d1a2a5c41 WatchSource:0}: Error finding container 24861db986d6c8c87deb43a53a4316ef162d10c360c66a1519d0882d1a2a5c41: Status 404 returned error can't find the container with id 24861db986d6c8c87deb43a53a4316ef162d10c360c66a1519d0882d1a2a5c41 Sep 08 08:47:36.917579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.917549 2561 apiserver.go:52] "Watching apiserver" Sep 08 08:47:36.923246 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.923217 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 08:47:36.925794 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.925764 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-q78xr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal","openshift-multus/network-metrics-daemon-krcc8","openshift-ovn-kubernetes/ovnkube-node-g6zpw","kube-system/global-pull-secret-syncer-s4s94","kube-system/konnectivity-agent-gzrff","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn","openshift-cluster-node-tuning-operator/tuned-74rcv","openshift-multus/multus-2tw75","openshift-multus/multus-additional-cni-plugins-6zk7p","openshift-network-diagnostics/network-check-target-cb5sh","openshift-network-operator/iptables-alerter-2rz5g","kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal","openshift-dns/node-resolver-4cgbf"] Sep 08 08:47:36.928641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.928605 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.930871 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.930838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:36.930999 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:36.930942 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:36.931176 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.931144 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 08:47:36.931299 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.931280 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6wx7w\"" Sep 08 08:47:36.931361 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.931298 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.931412 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.931394 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.933164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.933144 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:36.933290 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:36.933240 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:36.935746 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.935725 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.937847 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.937801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:36.937847 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.937841 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wzlsx\"" Sep 08 08:47:36.937999 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.937856 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.937999 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:36.937886 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:36.939359 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.939335 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 08:47:36.939359 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.939347 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 08:47:36.939530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.939510 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 08:47:36.939734 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.939711 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 08:47:36.941351 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.941331 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 08:47:36.942546 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.942519 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.942744 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.942724 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:36.944897 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.944877 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 08:47:36.945197 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.945165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 08:47:36.945197 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.945178 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tmm6g\"" Sep 08 08:47:36.945828 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.945496 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tw75" Sep 08 08:47:36.947471 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.947422 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.947595 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.947575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 08:47:36.947696 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.947575 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.947763 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.947730 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 08:47:36.947899 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.947876 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rswsg\"" Sep 08 08:47:36.948004 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.947985 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:36.950347 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.950312 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:36.950347 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.950337 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lcxlz\"" Sep 08 08:47:36.950521 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.950360 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.950521 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.950410 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.952468 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.952448 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.952567 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.952528 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kcgjw\"" Sep 08 08:47:36.952567 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.952542 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.952805 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.952786 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 08:47:36.952952 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.952929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:36.953052 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-registration-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.953134 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvxc5\" (UniqueName: \"kubernetes.io/projected/64148ce7-3db4-4b93-ac86-6595bf258483-kube-api-access-mvxc5\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.953134 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sfss\" (UniqueName: \"kubernetes.io/projected/030a7a26-d668-4f3f-8078-b7ed24dab6fc-kube-api-access-9sfss\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:36.953134 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:36.953134 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-device-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.953346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-run-netns\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-systemd\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-etc-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-ovn\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovnkube-config\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-kubelet\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-slash\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-var-lib-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-cni-bin\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovnkube-script-lib\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-sys-fs\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-log-socket\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9hrc\" (UniqueName: \"kubernetes.io/projected/63a95f25-5e90-4a7d-aad8-d11c4adea633-kube-api-access-c9hrc\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-systemd-units\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-socket-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-env-overrides\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovn-node-metrics-cert\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.953931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-cni-netd\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.954560 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.953978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16461164-6c50-4205-9337-d87538d7516f-kubelet-config\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:36.954560 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.954026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4779b1eb-03c9-4dbe-873e-53748854da3a-konnectivity-ca\") pod \"konnectivity-agent-gzrff\" (UID: \"4779b1eb-03c9-4dbe-873e-53748854da3a\") " pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:36.954560 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.954060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-node-log\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:36.954560 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.954107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16461164-6c50-4205-9337-d87538d7516f-dbus\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:36.954560 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.954155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4779b1eb-03c9-4dbe-873e-53748854da3a-agent-certs\") pod \"konnectivity-agent-gzrff\" (UID: \"4779b1eb-03c9-4dbe-873e-53748854da3a\") " pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:36.954560 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.954222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:36.955530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.955443 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 08:47:36.955530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.955473 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-24gc2\"" Sep 08 08:47:36.955530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.955481 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 08:47:36.956088 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.956068 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:36.958467 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.958427 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mnrfd\"" Sep 08 08:47:36.958621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.958468 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.958773 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.958745 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.958895 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.958747 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 08:47:36.966529 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.966495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:36.969231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.969150 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 08:47:36.969231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.969165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9nptz\"" Sep 08 08:47:36.969231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.969166 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 08:47:36.969535 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.969512 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 08:47:36.979359 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.979262 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fxxlr" Sep 08 08:47:36.987314 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:36.987282 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fxxlr" Sep 08 08:47:38.200453 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.200407 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 08:47:38.212078 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-tuned\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.212270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrbh\" (UniqueName: \"kubernetes.io/projected/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-kube-api-access-grrbh\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.212270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.212270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d3e720e-855d-49df-9935-cee51a00f900-cni-binary-copy\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-k8s-cni-cncf-io\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdq9x\" (UniqueName: \"kubernetes.io/projected/5d3e720e-855d-49df-9935-cee51a00f900-kube-api-access-zdq9x\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc98736-1625-4178-898d-173379416c5b-tmp-dir\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhwg6\" (UniqueName: \"kubernetes.io/projected/d447ddf8-b445-4684-ac1f-ddf307cfab4c-kube-api-access-jhwg6\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16461164-6c50-4205-9337-d87538d7516f-kubelet-config\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4779b1eb-03c9-4dbe-873e-53748854da3a-konnectivity-ca\") pod \"konnectivity-agent-gzrff\" (UID: \"4779b1eb-03c9-4dbe-873e-53748854da3a\") " pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-netns\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvxc5\" (UniqueName: \"kubernetes.io/projected/64148ce7-3db4-4b93-ac86-6595bf258483-kube-api-access-mvxc5\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.212490 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-system-cni-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-cni-bin\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-hostroot\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" event={"ID":"356d70d76887b88988d30ee1a1b2cbfb","Type":"ContainerStarted","Data":"24861db986d6c8c87deb43a53a4316ef162d10c360c66a1519d0882d1a2a5c41"} Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-kubernetes\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-run-netns\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-etc-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-slash\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-var-lib-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212735 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16461164-6c50-4205-9337-d87538d7516f-kubelet-config\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212760 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-cni-bin\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212845 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-cni-bin\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212871 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-run-netns\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-multus-certs\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.212929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212922 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-var-lib-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-var-lib-kubelet\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212892 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-slash\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212933 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-etc-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212892 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.212980 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212892 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.212993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-sys-fs\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213052 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-sys-fs\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.213073 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:47:38.713050439 +0000 UTC m=+3.030506650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213075 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-openvswitch\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-log-socket\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9hrc\" (UniqueName: \"kubernetes.io/projected/63a95f25-5e90-4a7d-aad8-d11c4adea633-kube-api-access-c9hrc\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8tb\" (UniqueName: \"kubernetes.io/projected/3fc98736-1625-4178-898d-173379416c5b-kube-api-access-kk8tb\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-systemd-units\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.213896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-cnibin\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-cnibin\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213285 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-systemd-units\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213316 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-log-socket\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213316 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-env-overrides\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovn-node-metrics-cert\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.213424 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213446 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-cni-multus\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-systemd\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.213485 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:47:38.713469435 +0000 UTC m=+3.030925647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-cni-netd\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysconfig\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.214758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213616 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-etc-selinux\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysctl-conf\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-cni-netd\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-system-cni-dir\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d447ddf8-b445-4684-ac1f-ddf307cfab4c-iptables-alerter-script\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-tmp\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fc98736-1625-4178-898d-173379416c5b-hosts-file\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213819 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4779b1eb-03c9-4dbe-873e-53748854da3a-konnectivity-ca\") pod \"konnectivity-agent-gzrff\" (UID: \"4779b1eb-03c9-4dbe-873e-53748854da3a\") " pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-etc-kubernetes\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-modprobe-d\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-node-log\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213937 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-node-log\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.213973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16461164-6c50-4205-9337-d87538d7516f-dbus\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214032 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-env-overrides\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4779b1eb-03c9-4dbe-873e-53748854da3a-agent-certs\") pod \"konnectivity-agent-gzrff\" (UID: \"4779b1eb-03c9-4dbe-873e-53748854da3a\") " pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-registration-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.215638 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214071 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16461164-6c50-4205-9337-d87538d7516f-dbus\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214118 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-registration-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214117 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214146 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sfss\" (UniqueName: \"kubernetes.io/projected/030a7a26-d668-4f3f-8078-b7ed24dab6fc-kube-api-access-9sfss\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-device-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-systemd\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-ovn\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovnkube-config\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214278 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-device-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovnkube-script-lib\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysctl-d\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-sys\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-kubelet\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-host\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d447ddf8-b445-4684-ac1f-ddf307cfab4c-host-slash\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214451 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-ovn\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-cni-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214462 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-host-kubelet\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.216519 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-conf-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63a95f25-5e90-4a7d-aad8-d11c4adea633-run-systemd\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d3e720e-855d-49df-9935-cee51a00f900-multus-daemon-config\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-run\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214563 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-lib-modules\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-host\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229x4\" (UniqueName: \"kubernetes.io/projected/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-kube-api-access-229x4\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-kubelet\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-serviceca\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr6ns\" (UniqueName: \"kubernetes.io/projected/aa12bc65-8115-4916-9cef-e702b1607378-kube-api-access-hr6ns\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-socket-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-socket-dir-parent\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214805 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovnkube-script-lib\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" event={"ID":"eaef65e55aa5f7053cfe7a3a8e382309","Type":"ContainerStarted","Data":"b3963057ca543711e02d2b81de3117194dd09bad738bb33faa7a3f755dfb4c07"} Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.214964 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64148ce7-3db4-4b93-ac86-6595bf258483-socket-dir\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.217527 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.215004 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovnkube-config\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.219359 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.219181 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:47:38.219568 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.219365 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:47:38.219568 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.219384 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:38.219568 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.219489 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:47:38.719465797 +0000 UTC m=+3.036922010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:38.220305 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.219948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63a95f25-5e90-4a7d-aad8-d11c4adea633-ovn-node-metrics-cert\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.220305 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.220091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4779b1eb-03c9-4dbe-873e-53748854da3a-agent-certs\") pod \"konnectivity-agent-gzrff\" (UID: \"4779b1eb-03c9-4dbe-873e-53748854da3a\") " pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:38.223305 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.223275 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvxc5\" (UniqueName: \"kubernetes.io/projected/64148ce7-3db4-4b93-ac86-6595bf258483-kube-api-access-mvxc5\") pod \"aws-ebs-csi-driver-node-9sqvn\" (UID: \"64148ce7-3db4-4b93-ac86-6595bf258483\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.223485 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.223275 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9hrc\" (UniqueName: \"kubernetes.io/projected/63a95f25-5e90-4a7d-aad8-d11c4adea633-kube-api-access-c9hrc\") pod \"ovnkube-node-g6zpw\" (UID: \"63a95f25-5e90-4a7d-aad8-d11c4adea633\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.226303 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.226267 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sfss\" (UniqueName: \"kubernetes.io/projected/030a7a26-d668-4f3f-8078-b7ed24dab6fc-kube-api-access-9sfss\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:38.309592 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.309555 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:47:38.316095 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysconfig\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316285 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysctl-conf\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316285 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316221 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysconfig\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316396 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-system-cni-dir\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.316396 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316296 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysctl-conf\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316396 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d447ddf8-b445-4684-ac1f-ddf307cfab4c-iptables-alerter-script\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.316396 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-system-cni-dir\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.316396 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-tmp\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316396 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fc98736-1625-4178-898d-173379416c5b-hosts-file\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-etc-kubernetes\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-modprobe-d\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysctl-d\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-sys\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-host\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d447ddf8-b445-4684-ac1f-ddf307cfab4c-host-slash\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-cni-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.316676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-conf-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-conf-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-sys\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316825 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-host\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-sysctl-d\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d447ddf8-b445-4684-ac1f-ddf307cfab4c-host-slash\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316901 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fc98736-1625-4178-898d-173379416c5b-hosts-file\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d3e720e-855d-49df-9935-cee51a00f900-multus-daemon-config\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316952 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-etc-kubernetes\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-run\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.316997 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-lib-modules\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317021 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-cni-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317052 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-modprobe-d\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-host\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317088 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229x4\" (UniqueName: \"kubernetes.io/projected/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-kube-api-access-229x4\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317095 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-run\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317161 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-lib-modules\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-kubelet\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-serviceca\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr6ns\" (UniqueName: \"kubernetes.io/projected/aa12bc65-8115-4916-9cef-e702b1607378-kube-api-access-hr6ns\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-socket-dir-parent\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317291 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-tuned\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317355 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-host\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317374 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-kubelet\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grrbh\" (UniqueName: \"kubernetes.io/projected/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-kube-api-access-grrbh\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317615 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317670 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-multus-socket-dir-parent\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d3e720e-855d-49df-9935-cee51a00f900-cni-binary-copy\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317715 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d3e720e-855d-49df-9935-cee51a00f900-multus-daemon-config\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.317857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d447ddf8-b445-4684-ac1f-ddf307cfab4c-iptables-alerter-script\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-k8s-cni-cncf-io\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.317990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdq9x\" (UniqueName: \"kubernetes.io/projected/5d3e720e-855d-49df-9935-cee51a00f900-kube-api-access-zdq9x\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318018 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc98736-1625-4178-898d-173379416c5b-tmp-dir\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwg6\" (UniqueName: \"kubernetes.io/projected/d447ddf8-b445-4684-ac1f-ddf307cfab4c-kube-api-access-jhwg6\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-netns\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318219 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d3e720e-855d-49df-9935-cee51a00f900-cni-binary-copy\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-system-cni-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318295 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-system-cni-dir\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318281 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-k8s-cni-cncf-io\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-cni-bin\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-hostroot\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-kubernetes\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-cni-bin\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-netns\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318452 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-hostroot\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-multus-certs\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.318643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318483 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-kubernetes\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-var-lib-kubelet\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318520 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-run-multus-certs\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318554 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fc98736-1625-4178-898d-173379416c5b-tmp-dir\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8tb\" (UniqueName: \"kubernetes.io/projected/3fc98736-1625-4178-898d-173379416c5b-kube-api-access-kk8tb\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-var-lib-kubelet\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-cnibin\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318672 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-cnibin\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318696 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-cnibin\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-cni-multus\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-systemd\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318811 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa12bc65-8115-4916-9cef-e702b1607378-cnibin\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-systemd\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318854 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d3e720e-855d-49df-9935-cee51a00f900-host-var-lib-cni-multus\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.318941 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-serviceca\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.319445 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.319116 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa12bc65-8115-4916-9cef-e702b1607378-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.320195 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.319709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-tmp\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.320721 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.320677 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-etc-tuned\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.326611 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.326450 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrbh\" (UniqueName: \"kubernetes.io/projected/d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf-kube-api-access-grrbh\") pod \"node-ca-q78xr\" (UID: \"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf\") " pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.326775 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.326693 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdq9x\" (UniqueName: \"kubernetes.io/projected/5d3e720e-855d-49df-9935-cee51a00f900-kube-api-access-zdq9x\") pod \"multus-2tw75\" (UID: \"5d3e720e-855d-49df-9935-cee51a00f900\") " pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.326867 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.326782 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-229x4\" (UniqueName: \"kubernetes.io/projected/9e78720e-40a0-460a-9cf3-1219bf3fd8a9-kube-api-access-229x4\") pod \"tuned-74rcv\" (UID: \"9e78720e-40a0-460a-9cf3-1219bf3fd8a9\") " pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.327205 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.327175 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhwg6\" (UniqueName: \"kubernetes.io/projected/d447ddf8-b445-4684-ac1f-ddf307cfab4c-kube-api-access-jhwg6\") pod \"iptables-alerter-2rz5g\" (UID: \"d447ddf8-b445-4684-ac1f-ddf307cfab4c\") " pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.327354 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.327334 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8tb\" (UniqueName: \"kubernetes.io/projected/3fc98736-1625-4178-898d-173379416c5b-kube-api-access-kk8tb\") pod \"node-resolver-4cgbf\" (UID: \"3fc98736-1625-4178-898d-173379416c5b\") " pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.327411 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.327332 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr6ns\" (UniqueName: \"kubernetes.io/projected/aa12bc65-8115-4916-9cef-e702b1607378-kube-api-access-hr6ns\") pod \"multus-additional-cni-plugins-6zk7p\" (UID: \"aa12bc65-8115-4916-9cef-e702b1607378\") " pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.398247 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.398206 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" Sep 08 08:47:38.408367 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.408327 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:47:38.424770 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.424706 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:47:38.432920 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.432881 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tw75" Sep 08 08:47:38.441162 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.441121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cgbf" Sep 08 08:47:38.449571 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.449532 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-74rcv" Sep 08 08:47:38.454935 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.454876 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" Sep 08 08:47:38.461007 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.460971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q78xr" Sep 08 08:47:38.468975 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.468942 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2rz5g" Sep 08 08:47:38.721731 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.721625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:38.721731 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.721697 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:38.721801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721820 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721848 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721857 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721862 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721918 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721926 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:47:39.721908039 +0000 UTC m=+4.039364255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:38.721988 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.721981 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:47:39.721969176 +0000 UTC m=+4.039425371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:38.722278 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:38.722007 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:47:39.72198814 +0000 UTC m=+4.039444341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:39.148432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.148279 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 08:42:38 +0000 UTC" deadline="2028-04-11 16:35:58.704152002 +0000 UTC" Sep 08 08:47:39.148432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.148381 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13951h48m19.555777938s" Sep 08 08:47:39.207801 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.207762 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:39.207968 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.207836 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:39.207968 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.207903 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:39.208046 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.208008 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:39.269639 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.269162 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b0ee56_8d0e_485f_b0e3_87d1f22d02cf.slice/crio-a221437516799ff69a7ce9c018eee29169be30470f0e231fb688d8785f663381 WatchSource:0}: Error finding container a221437516799ff69a7ce9c018eee29169be30470f0e231fb688d8785f663381: Status 404 returned error can't find the container with id a221437516799ff69a7ce9c018eee29169be30470f0e231fb688d8785f663381 Sep 08 08:47:39.272581 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.272512 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc98736_1625_4178_898d_173379416c5b.slice/crio-fe2dd90a0f6158a17c886054cf66a020f0b90910e116ba7273d8d6787591f5e0 WatchSource:0}: Error finding container fe2dd90a0f6158a17c886054cf66a020f0b90910e116ba7273d8d6787591f5e0: Status 404 returned error can't find the container with id fe2dd90a0f6158a17c886054cf66a020f0b90910e116ba7273d8d6787591f5e0 Sep 08 08:47:39.275163 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.274847 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d3e720e_855d_49df_9935_cee51a00f900.slice/crio-d7c8984e6c9bbaa1a6e742e58b2e8103e41902e849d5144ae2d5b3b258a14646 WatchSource:0}: Error finding container d7c8984e6c9bbaa1a6e742e58b2e8103e41902e849d5144ae2d5b3b258a14646: Status 404 returned error can't find the container with id d7c8984e6c9bbaa1a6e742e58b2e8103e41902e849d5144ae2d5b3b258a14646 Sep 08 08:47:39.275650 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.275621 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64148ce7_3db4_4b93_ac86_6595bf258483.slice/crio-fb9ac6e372cfe5a5278776e8d31b1fdc9275cbe8ba8ed76a49a3357e2953dac2 WatchSource:0}: Error finding container fb9ac6e372cfe5a5278776e8d31b1fdc9275cbe8ba8ed76a49a3357e2953dac2: Status 404 returned error can't find the container with id fb9ac6e372cfe5a5278776e8d31b1fdc9275cbe8ba8ed76a49a3357e2953dac2 Sep 08 08:47:39.277830 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.277799 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd447ddf8_b445_4684_ac1f_ddf307cfab4c.slice/crio-eca7d01dffd0d34f95a7c2644ef27ba93cac945bc9c908097d70612c65f3240a WatchSource:0}: Error finding container eca7d01dffd0d34f95a7c2644ef27ba93cac945bc9c908097d70612c65f3240a: Status 404 returned error can't find the container with id eca7d01dffd0d34f95a7c2644ef27ba93cac945bc9c908097d70612c65f3240a Sep 08 08:47:39.281340 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.281298 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4779b1eb_03c9_4dbe_873e_53748854da3a.slice/crio-ac03e28be33ddd9cdef7daad83a53e7240b0a4622a190f101c42d6413ec4df2a WatchSource:0}: Error finding container ac03e28be33ddd9cdef7daad83a53e7240b0a4622a190f101c42d6413ec4df2a: Status 404 returned error can't find the container with id ac03e28be33ddd9cdef7daad83a53e7240b0a4622a190f101c42d6413ec4df2a Sep 08 08:47:39.286065 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:47:39.285907 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa12bc65_8115_4916_9cef_e702b1607378.slice/crio-2b6eb3778b12213437d2f219d3f0d9d75b8b4057cb44d380d3cd557a95cbb7c5 WatchSource:0}: Error finding container 2b6eb3778b12213437d2f219d3f0d9d75b8b4057cb44d380d3cd557a95cbb7c5: Status 404 returned error can't find the container with id 2b6eb3778b12213437d2f219d3f0d9d75b8b4057cb44d380d3cd557a95cbb7c5 Sep 08 08:47:39.551506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.551473 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 08:47:39.731203 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.731156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:39.731407 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.731220 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:39.731407 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:39.731260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:39.731407 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731364 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:39.731578 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731448 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:47:41.731425908 +0000 UTC m=+6.048882127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:39.731578 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731513 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:47:39.731578 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731546 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:47:39.731578 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731561 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:39.731894 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731617 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:47:41.731599752 +0000 UTC m=+6.049055971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:39.731894 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731726 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:39.731894 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:39.731786 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:47:41.731772594 +0000 UTC m=+6.049228806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:40.149021 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.148945 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 08:42:38 +0000 UTC" deadline="2028-02-24 16:17:17.89673538 +0000 UTC" Sep 08 08:47:40.149021 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.148987 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12823h29m37.747752792s" Sep 08 08:47:40.208197 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.208158 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:40.208434 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:40.208306 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:40.234436 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.234392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q78xr" event={"ID":"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf","Type":"ContainerStarted","Data":"a221437516799ff69a7ce9c018eee29169be30470f0e231fb688d8785f663381"} Sep 08 08:47:40.247655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.247612 2561 generic.go:356] "Generic (PLEG): container finished" podID="356d70d76887b88988d30ee1a1b2cbfb" containerID="eb035027c9168e1a444c7685717238c9059d234f1e735c515e8693d74d60e1a4" exitCode=0 Sep 08 08:47:40.247896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.247764 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" event={"ID":"356d70d76887b88988d30ee1a1b2cbfb","Type":"ContainerDied","Data":"eb035027c9168e1a444c7685717238c9059d234f1e735c515e8693d74d60e1a4"} Sep 08 08:47:40.263884 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.263500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" event={"ID":"eaef65e55aa5f7053cfe7a3a8e382309","Type":"ContainerStarted","Data":"2d5752c081ae9a04e4b7e06199350c6d107d96ba2548187e7a0268557efd5a9f"} Sep 08 08:47:40.290578 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.290385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"cf9959462ead11208a31624986a454114521d659ce799bc333b1ed19ad9443da"} Sep 08 08:47:40.299174 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.299050 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerStarted","Data":"2b6eb3778b12213437d2f219d3f0d9d75b8b4057cb44d380d3cd557a95cbb7c5"} Sep 08 08:47:40.308321 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.308281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gzrff" event={"ID":"4779b1eb-03c9-4dbe-873e-53748854da3a","Type":"ContainerStarted","Data":"ac03e28be33ddd9cdef7daad83a53e7240b0a4622a190f101c42d6413ec4df2a"} Sep 08 08:47:40.325687 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.325562 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2rz5g" event={"ID":"d447ddf8-b445-4684-ac1f-ddf307cfab4c","Type":"ContainerStarted","Data":"eca7d01dffd0d34f95a7c2644ef27ba93cac945bc9c908097d70612c65f3240a"} Sep 08 08:47:40.332035 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.331124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tw75" event={"ID":"5d3e720e-855d-49df-9935-cee51a00f900","Type":"ContainerStarted","Data":"d7c8984e6c9bbaa1a6e742e58b2e8103e41902e849d5144ae2d5b3b258a14646"} Sep 08 08:47:40.352036 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.351978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-74rcv" event={"ID":"9e78720e-40a0-460a-9cf3-1219bf3fd8a9","Type":"ContainerStarted","Data":"e363f8645c94826ac2dada1852eb4b6bcb7133f578c620571af42a119a133590"} Sep 08 08:47:40.366955 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.366864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" event={"ID":"64148ce7-3db4-4b93-ac86-6595bf258483","Type":"ContainerStarted","Data":"fb9ac6e372cfe5a5278776e8d31b1fdc9275cbe8ba8ed76a49a3357e2953dac2"} Sep 08 08:47:40.382086 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:40.382042 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cgbf" event={"ID":"3fc98736-1625-4178-898d-173379416c5b","Type":"ContainerStarted","Data":"fe2dd90a0f6158a17c886054cf66a020f0b90910e116ba7273d8d6787591f5e0"} Sep 08 08:47:41.210982 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.210102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:41.210982 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.210284 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:41.210982 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.210785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:41.210982 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.210884 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:41.406587 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.406534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" event={"ID":"356d70d76887b88988d30ee1a1b2cbfb","Type":"ContainerStarted","Data":"bf12dbaf63ebf129cb9a4cbde2e51dbbea688d1cb7992d4196019d1ba8c2945e"} Sep 08 08:47:41.422721 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.422653 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" podStartSLOduration=4.422632889 podStartE2EDuration="4.422632889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:41.422504942 +0000 UTC m=+5.739961208" watchObservedRunningTime="2026-09-08 08:47:41.422632889 +0000 UTC m=+5.740089109" Sep 08 08:47:41.423611 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.423567 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" podStartSLOduration=4.423550812 podStartE2EDuration="4.423550812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:40.277925379 +0000 UTC m=+4.595381598" watchObservedRunningTime="2026-09-08 08:47:41.423550812 +0000 UTC m=+5.741007031" Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.749867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.749920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:41.749956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750077 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750138 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:47:45.750120145 +0000 UTC m=+10.067576357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750532 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:47:45.750563206 +0000 UTC m=+10.068019418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750654 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750672 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750696 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:41.752059 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:41.750732 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:47:45.750720019 +0000 UTC m=+10.068176231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:42.207328 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:42.207267 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:42.207521 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:42.207431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:43.208207 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:43.208170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:43.208682 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:43.208331 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:43.208774 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:43.208678 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:43.208832 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:43.208785 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:44.212168 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:44.211722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:44.212168 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:44.211846 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:45.207530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:45.207136 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:45.207530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:45.207308 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:45.207801 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.207546 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:45.207801 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.207766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:45.784126 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:45.784077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:45.784137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:45.784172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784270 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784287 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784323 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784339 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784355 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:47:53.784333751 +0000 UTC m=+18.101789961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784395 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:47:53.784379586 +0000 UTC m=+18.101835805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784291 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:45.784707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:45.784447 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:47:53.784435464 +0000 UTC m=+18.101891691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:46.208572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:46.208332 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:46.208572 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:46.208460 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:47.207975 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:47.207887 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:47.207975 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:47.207927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:47.208599 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:47.208054 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:47.208599 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:47.208251 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:48.207682 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:48.207645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:48.207868 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:48.207797 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:49.207621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:49.207561 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:49.207621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:49.207599 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:49.208189 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:49.207778 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:49.208189 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:49.207874 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:50.207781 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:50.207673 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:50.208248 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:50.207833 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:51.207285 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:51.207246 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:51.207475 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:51.207304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:51.207475 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:51.207390 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:51.207592 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:51.207524 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:52.207225 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:52.207186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:52.207711 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:52.207331 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:53.208171 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:53.208129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:53.208171 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:53.208159 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:53.208728 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.208272 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:53.208728 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.208443 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:53.849626 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:53.849585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:53.849626 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:53.849627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:53.849650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849784 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849790 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849810 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849820 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849837 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:48:09.849821897 +0000 UTC m=+34.167278105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849860 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:09.849848895 +0000 UTC m=+34.167305116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849780 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:53.849965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:53.849924 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:48:09.849907066 +0000 UTC m=+34.167363281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:47:54.207511 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:54.207425 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:54.207670 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:54.207548 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:55.207309 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:55.207270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:55.207784 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:55.207270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:55.207784 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:55.207409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:55.207784 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:55.207506 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:56.208226 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:56.208187 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:56.208841 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:56.208307 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:57.207484 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:57.207447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:57.207484 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:57.207483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:57.207704 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:57.207594 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:57.207760 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:57.207704 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:58.209894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.207833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:47:58.209894 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:58.208263 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:47:58.451670 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.451628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" event={"ID":"64148ce7-3db4-4b93-ac86-6595bf258483","Type":"ContainerStarted","Data":"eb1194586a5226064fadf755f75b2b64dfa9b9469b4c043cc3e2af6709423999"} Sep 08 08:47:58.453100 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.453072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cgbf" event={"ID":"3fc98736-1625-4178-898d-173379416c5b","Type":"ContainerStarted","Data":"25c5b28e76e4d111fdb81220f9223f994a1a4ed15cfbf3022de3831189ebab0e"} Sep 08 08:47:58.454518 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.454486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q78xr" event={"ID":"d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf","Type":"ContainerStarted","Data":"a10638b1058a1927708349ef5cf1820fe089ac4a5e550984e87ec32c1ab94b87"} Sep 08 08:47:58.457545 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.457516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"1b9310db8875ba825b846e08cac909a441ec28f22674e3642c9d4b4846ac998e"} Sep 08 08:47:58.457661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.457584 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"ff8da6f996b9434e7a72784a7b84180174611ddfeb5f7dc72d9d8e80fdad7af6"} Sep 08 08:47:58.457661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.457614 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"929b66c7adad3e56b0bc57b9c94ad6c57a4de17f714fb3894ae0032ff8144960"} Sep 08 08:47:58.457661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.457649 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"164143749f0a692db5a298effa6763d998c056d7c184bc82dd303a78f3739862"} Sep 08 08:47:58.457851 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.457677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"53eead5c9b912c554d5407dd74e41f1c93e9b175256b2eeb045757b94242761d"} Sep 08 08:47:58.457851 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.457711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"fd938fafeae1f590ecb167e31a2dd2b62d5aaa17a19321f3523414d352c1fbdd"} Sep 08 08:47:58.459045 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.459023 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12bc65-8115-4916-9cef-e702b1607378" containerID="a0fa38c0c0b5b0098a1e0368c5611e7e0657c382701f687bd4dd5b8a62042f8b" exitCode=0 Sep 08 08:47:58.459136 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.459104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerDied","Data":"a0fa38c0c0b5b0098a1e0368c5611e7e0657c382701f687bd4dd5b8a62042f8b"} Sep 08 08:47:58.460819 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.460715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gzrff" event={"ID":"4779b1eb-03c9-4dbe-873e-53748854da3a","Type":"ContainerStarted","Data":"d3ac5593184a667899b88327321328cbd5ee936d837b233843da27b0beba6ebe"} Sep 08 08:47:58.462417 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.462385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tw75" event={"ID":"5d3e720e-855d-49df-9935-cee51a00f900","Type":"ContainerStarted","Data":"4076d292760cbf4b24cf9e53a7bc15f54657a93378fd457ff67a3eeee17c1014"} Sep 08 08:47:58.463842 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.463811 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-74rcv" event={"ID":"9e78720e-40a0-460a-9cf3-1219bf3fd8a9","Type":"ContainerStarted","Data":"7b4e7fac20dc4e6e41d76ebca99de975fd29b9a3a51a79d09f632224827fb8dd"} Sep 08 08:47:58.468589 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.468539 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4cgbf" podStartSLOduration=4.383093027 podStartE2EDuration="22.468522468s" totalImagesPullingTime="18.085429441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:58.468481102 +0000 UTC m=+22.785937320" watchObservedRunningTime="2026-09-08 08:47:58.468522468 +0000 UTC m=+22.785978686" Sep 08 08:47:58.482059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.482005 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gzrff" podStartSLOduration=11.742333903 podStartE2EDuration="22.481983394s" totalImagesPullingTime="10.739649491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:58.481720388 +0000 UTC m=+22.799176605" watchObservedRunningTime="2026-09-08 08:47:58.481983394 +0000 UTC m=+22.799439613" Sep 08 08:47:58.498862 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.498799 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2tw75" podStartSLOduration=4.361464042 podStartE2EDuration="22.498777529s" totalImagesPullingTime="18.137313487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:58.498565628 +0000 UTC m=+22.816021845" watchObservedRunningTime="2026-09-08 08:47:58.498777529 +0000 UTC m=+22.816233746" Sep 08 08:47:58.515478 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.515403 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-74rcv" podStartSLOduration=4.43253302 podStartE2EDuration="22.515372479s" totalImagesPullingTime="18.082839459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:58.515144907 +0000 UTC m=+22.832601124" watchObservedRunningTime="2026-09-08 08:47:58.515372479 +0000 UTC m=+22.832828703" Sep 08 08:47:58.548813 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:58.548759 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q78xr" podStartSLOduration=4.457154893 podStartE2EDuration="22.548717328s" totalImagesPullingTime="18.091562435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:58.548070586 +0000 UTC m=+22.865526806" watchObservedRunningTime="2026-09-08 08:47:58.548717328 +0000 UTC m=+22.866173546" Sep 08 08:47:59.207439 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:59.207346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:47:59.207580 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:59.207462 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:47:59.207580 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:59.207507 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:47:59.207658 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:47:59.207615 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:47:59.440909 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:59.440672 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 08:47:59.468794 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:59.468652 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2rz5g" event={"ID":"d447ddf8-b445-4684-ac1f-ddf307cfab4c","Type":"ContainerStarted","Data":"1e814bdc2c1d66ed1059d204379ce4e3446feff490bddad5cb32358613a99941"} Sep 08 08:47:59.471232 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:59.471192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" event={"ID":"64148ce7-3db4-4b93-ac86-6595bf258483","Type":"ContainerStarted","Data":"fd0aa985e17aa67c7608974a931b73851c8de43101671be969456dee14148e2a"} Sep 08 08:47:59.484442 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:47:59.484377 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2rz5g" podStartSLOduration=5.40372458 podStartE2EDuration="23.484354772s" totalImagesPullingTime="18.080630192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:47:59.48354051 +0000 UTC m=+23.800996728" watchObservedRunningTime="2026-09-08 08:47:59.484354772 +0000 UTC m=+23.801810991" Sep 08 08:48:00.190753 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.190544 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T08:47:59.440903883Z","UUID":"49fd8a37-ebc7-4314-bb24-d5d3296b7cd4","Handler":null,"Name":"","Endpoint":""} Sep 08 08:48:00.192755 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.192698 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 08:48:00.192755 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.192736 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 08:48:00.208014 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.207958 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:00.208187 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:00.208102 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:00.479271 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.479233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"d71f5551b82627e2d2e1de50ecb9aafcb0631a42fcb5b8138bd718c2abf791ca"} Sep 08 08:48:00.879828 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.879703 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:48:00.880497 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.880473 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:48:00.974026 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.973992 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:48:00.974661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:00.974631 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gzrff" Sep 08 08:48:01.207199 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:01.207114 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:01.207199 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:01.207142 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:01.207419 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:01.207243 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:48:01.207419 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:01.207391 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:48:01.483920 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:01.483827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" event={"ID":"64148ce7-3db4-4b93-ac86-6595bf258483","Type":"ContainerStarted","Data":"afa4a9dfc9c455fa087f747ebe256d33a0bfa821ef91710c7130c4011280450b"} Sep 08 08:48:01.502150 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:01.502083 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9sqvn" podStartSLOduration=4.669619531 podStartE2EDuration="25.502061757s" totalImagesPullingTime="20.832442226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:01.501723261 +0000 UTC m=+25.819179479" watchObservedRunningTime="2026-09-08 08:48:01.502061757 +0000 UTC m=+25.819518005" Sep 08 08:48:02.207357 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:02.207321 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:02.207563 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:02.207453 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:03.207796 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.207556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:03.208231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.207615 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:03.208231 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:03.207878 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:48:03.208231 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:03.207966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:48:03.492459 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.492357 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" event={"ID":"63a95f25-5e90-4a7d-aad8-d11c4adea633","Type":"ContainerStarted","Data":"7f18a88bc43e76123f9d5139e3f7c1a05c096048820efb664c31a051a2a82c5b"} Sep 08 08:48:03.492669 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.492627 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:48:03.492798 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.492716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:48:03.494532 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.494503 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12bc65-8115-4916-9cef-e702b1607378" containerID="017adedb47a193cf58721c2fac0907aa7cc4dbd60c22354043e8a3e50716affb" exitCode=0 Sep 08 08:48:03.494672 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.494543 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerDied","Data":"017adedb47a193cf58721c2fac0907aa7cc4dbd60c22354043e8a3e50716affb"} Sep 08 08:48:03.509998 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.509956 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:48:03.522952 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:03.522891 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" podStartSLOduration=9.39490328 podStartE2EDuration="27.522876242s" totalImagesPullingTime="18.127972962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:03.521813679 +0000 UTC m=+27.839269896" watchObservedRunningTime="2026-09-08 08:48:03.522876242 +0000 UTC m=+27.840332460" Sep 08 08:48:04.207803 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.207734 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:04.208704 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:04.207922 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:04.500716 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.500670 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:48:04.519915 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.519883 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:48:04.835219 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.835012 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4s94"] Sep 08 08:48:04.835417 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.835343 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:04.835489 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:04.835474 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:04.838523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.838478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cb5sh"] Sep 08 08:48:04.838767 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.838629 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:04.838767 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:04.838753 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:48:04.839281 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.839252 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-krcc8"] Sep 08 08:48:04.839413 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:04.839389 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:04.839509 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:04.839488 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:48:05.502483 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:05.502444 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12bc65-8115-4916-9cef-e702b1607378" containerID="536df8d8ec42cdf2dbb1e38c15280753bacf46c5c1cc800f3ea917c6fce72d72" exitCode=0 Sep 08 08:48:05.503281 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:05.502528 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerDied","Data":"536df8d8ec42cdf2dbb1e38c15280753bacf46c5c1cc800f3ea917c6fce72d72"} Sep 08 08:48:06.209226 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:06.209186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:06.209406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:06.209275 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:06.209406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:06.209306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:06.209406 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:06.209334 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:48:06.209406 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:06.209371 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:06.209547 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:06.209451 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:48:06.508605 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:06.508567 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12bc65-8115-4916-9cef-e702b1607378" containerID="284988b087f3bb6939f643643dabdb49fea0b16303dae791c53d96cb4b5e0f7a" exitCode=0 Sep 08 08:48:06.508605 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:06.508602 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerDied","Data":"284988b087f3bb6939f643643dabdb49fea0b16303dae791c53d96cb4b5e0f7a"} Sep 08 08:48:08.207459 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:08.207419 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:08.207459 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:08.207456 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:08.208077 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:08.207466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:08.208077 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:08.207552 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:48:08.208077 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:08.207620 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:48:08.208077 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:08.207711 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:09.868373 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:09.868319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:09.868389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:09.868426 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868475 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868554 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret podName:16461164-6c50-4205-9337-d87538d7516f nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.868537062 +0000 UTC m=+66.185993270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret") pod "global-pull-secret-syncer-s4s94" (UID: "16461164-6c50-4205-9337-d87538d7516f") : object "kube-system"/"original-pull-secret" not registered Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868559 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868581 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868609 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868613 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.868597392 +0000 UTC m=+66.186053607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868623 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xtv85 for pod openshift-network-diagnostics/network-check-target-cb5sh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:48:09.868984 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:09.868665 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85 podName:ebae9480-b9a6-479e-9e97-521e48b4ea98 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.868653478 +0000 UTC m=+66.186109693 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtv85" (UniqueName: "kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85") pod "network-check-target-cb5sh" (UID: "ebae9480-b9a6-479e-9e97-521e48b4ea98") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 08:48:10.208025 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:10.207918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:10.208025 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:10.207918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:10.208269 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:10.208092 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krcc8" podUID="030a7a26-d668-4f3f-8078-b7ed24dab6fc" Sep 08 08:48:10.208269 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:10.208140 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:10.208269 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:10.208258 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cb5sh" podUID="ebae9480-b9a6-479e-9e97-521e48b4ea98" Sep 08 08:48:10.208443 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:10.208411 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4s94" podUID="16461164-6c50-4205-9337-d87538d7516f" Sep 08 08:48:10.956199 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:10.956168 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeReady" Sep 08 08:48:10.956669 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:10.956324 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 08:48:10.998181 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:10.998142 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qhckf"] Sep 08 08:48:11.014862 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.014821 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vxt2r"] Sep 08 08:48:11.015040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.015002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.018227 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.018127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 08:48:11.018227 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.018137 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 08:48:11.018227 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.018212 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pkgjn\"" Sep 08 08:48:11.024827 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.024795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhckf"] Sep 08 08:48:11.024962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.024854 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vxt2r"] Sep 08 08:48:11.024962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.024951 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.027298 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.027268 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 08:48:11.027298 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.027281 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hpdn6\"" Sep 08 08:48:11.027492 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.027343 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 08:48:11.027492 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.027282 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 08:48:11.077784 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.077719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4dc8f1d-a522-454e-9a6b-63decf8f371c-tmp-dir\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.077784 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.077782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtzlw\" (UniqueName: \"kubernetes.io/projected/b4dc8f1d-a522-454e-9a6b-63decf8f371c-kube-api-access-mtzlw\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.078009 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.077864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dc8f1d-a522-454e-9a6b-63decf8f371c-config-volume\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.078009 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.077921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.178392 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4dc8f1d-a522-454e-9a6b-63decf8f371c-tmp-dir\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.178392 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzlw\" (UniqueName: \"kubernetes.io/projected/b4dc8f1d-a522-454e-9a6b-63decf8f371c-kube-api-access-mtzlw\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.178499 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dc8f1d-a522-454e-9a6b-63decf8f371c-config-volume\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.178499 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnk8z\" (UniqueName: \"kubernetes.io/projected/fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4-kube-api-access-gnk8z\") pod \"ingress-canary-vxt2r\" (UID: \"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4\") " pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.178595 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.178595 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4-cert\") pod \"ingress-canary-vxt2r\" (UID: \"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4\") " pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.178595 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.178568 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4dc8f1d-a522-454e-9a6b-63decf8f371c-tmp-dir\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.178738 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:11.178654 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 08:48:11.178738 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:11.178709 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls podName:b4dc8f1d-a522-454e-9a6b-63decf8f371c nodeName:}" failed. No retries permitted until 2026-09-08 08:48:11.678692511 +0000 UTC m=+35.996148721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls") pod "dns-default-qhckf" (UID: "b4dc8f1d-a522-454e-9a6b-63decf8f371c") : secret "dns-default-metrics-tls" not found Sep 08 08:48:11.179070 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.179045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dc8f1d-a522-454e-9a6b-63decf8f371c-config-volume\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.188965 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.188781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtzlw\" (UniqueName: \"kubernetes.io/projected/b4dc8f1d-a522-454e-9a6b-63decf8f371c-kube-api-access-mtzlw\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.279338 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.279284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4-cert\") pod \"ingress-canary-vxt2r\" (UID: \"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4\") " pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.279541 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.279371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnk8z\" (UniqueName: \"kubernetes.io/projected/fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4-kube-api-access-gnk8z\") pod \"ingress-canary-vxt2r\" (UID: \"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4\") " pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.282007 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.281977 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4-cert\") pod \"ingress-canary-vxt2r\" (UID: \"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4\") " pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.287815 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.287792 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnk8z\" (UniqueName: \"kubernetes.io/projected/fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4-kube-api-access-gnk8z\") pod \"ingress-canary-vxt2r\" (UID: \"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4\") " pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.334658 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.334619 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vxt2r" Sep 08 08:48:11.525189 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.525155 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12bc65-8115-4916-9cef-e702b1607378" containerID="a801b95d86adeacf887f3ba9305542327da6233adf6163374791956eb0563866" exitCode=0 Sep 08 08:48:11.525377 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.525219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerDied","Data":"a801b95d86adeacf887f3ba9305542327da6233adf6163374791956eb0563866"} Sep 08 08:48:11.646018 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.645980 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vxt2r"] Sep 08 08:48:11.650208 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:11.650173 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec8a155_9af6_4b8a_8f2c_b2ea5e7d59d4.slice/crio-0102e01576d154134914aa2531bca6b4db950e2e40f2a27b4f9feb606044ab60 WatchSource:0}: Error finding container 0102e01576d154134914aa2531bca6b4db950e2e40f2a27b4f9feb606044ab60: Status 404 returned error can't find the container with id 0102e01576d154134914aa2531bca6b4db950e2e40f2a27b4f9feb606044ab60 Sep 08 08:48:11.682065 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:11.682034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:11.682204 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:11.682182 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 08:48:11.682262 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:11.682250 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls podName:b4dc8f1d-a522-454e-9a6b-63decf8f371c nodeName:}" failed. No retries permitted until 2026-09-08 08:48:12.682230408 +0000 UTC m=+36.999686627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls") pod "dns-default-qhckf" (UID: "b4dc8f1d-a522-454e-9a6b-63decf8f371c") : secret "dns-default-metrics-tls" not found Sep 08 08:48:12.207604 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.207564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:12.208570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.207564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:12.208570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.207564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:12.210115 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.210089 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d8k6z\"" Sep 08 08:48:12.210266 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.210174 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 08:48:12.211003 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.210949 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 08:48:12.211003 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.210967 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 08:48:12.211218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.211024 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 08:48:12.211218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.211127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dt6vp\"" Sep 08 08:48:12.458868 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.458733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:12.532059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.532023 2561 generic.go:356] "Generic (PLEG): container finished" podID="aa12bc65-8115-4916-9cef-e702b1607378" containerID="a6fbd6bb4136ba7465bbb023e0a5ef5c0d3d4782bb927044ad4c39b8561976f9" exitCode=0 Sep 08 08:48:12.532232 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.532093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerDied","Data":"a6fbd6bb4136ba7465bbb023e0a5ef5c0d3d4782bb927044ad4c39b8561976f9"} Sep 08 08:48:12.533614 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.533582 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vxt2r" event={"ID":"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4","Type":"ContainerStarted","Data":"0102e01576d154134914aa2531bca6b4db950e2e40f2a27b4f9feb606044ab60"} Sep 08 08:48:12.561219 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.561176 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:12.689584 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:12.689538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:12.689721 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:12.689686 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 08:48:12.689789 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:12.689779 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls podName:b4dc8f1d-a522-454e-9a6b-63decf8f371c nodeName:}" failed. No retries permitted until 2026-09-08 08:48:14.689739975 +0000 UTC m=+39.007196184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls") pod "dns-default-qhckf" (UID: "b4dc8f1d-a522-454e-9a6b-63decf8f371c") : secret "dns-default-metrics-tls" not found Sep 08 08:48:13.014104 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:13.014065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:13.069050 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:13.068941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:13.540868 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:13.540831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" event={"ID":"aa12bc65-8115-4916-9cef-e702b1607378","Type":"ContainerStarted","Data":"4ef3dcb3095dc2993ea66c0fa08d098abfd454fd6f1f191acb9aa83df3b21313"} Sep 08 08:48:13.564092 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:13.564023 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6zk7p" podStartSLOduration=8.819096676000001 podStartE2EDuration="37.563996361s" totalImagesPullingTime="28.744899685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:13.562410288 +0000 UTC m=+37.879866505" watchObservedRunningTime="2026-09-08 08:48:13.563996361 +0000 UTC m=+37.881452580" Sep 08 08:48:13.685653 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:13.685601 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:13.787891 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:13.787856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:14.545482 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:14.545430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vxt2r" event={"ID":"fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4","Type":"ContainerStarted","Data":"fa3000b12bdc2ea6085fd5163770ea031eecf429926df393976c53fc8bfaa1b0"} Sep 08 08:48:14.562845 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:14.562788 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vxt2r" podStartSLOduration=2.018325104 podStartE2EDuration="4.562769345s" totalImagesPullingTime="2.544444241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:14.561738806 +0000 UTC m=+38.879195025" watchObservedRunningTime="2026-09-08 08:48:14.562769345 +0000 UTC m=+38.880225553" Sep 08 08:48:14.708647 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:14.708597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:14.708900 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:14.708775 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 08:48:14.708900 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:14.708848 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls podName:b4dc8f1d-a522-454e-9a6b-63decf8f371c nodeName:}" failed. No retries permitted until 2026-09-08 08:48:18.708828244 +0000 UTC m=+43.026284454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls") pod "dns-default-qhckf" (UID: "b4dc8f1d-a522-454e-9a6b-63decf8f371c") : secret "dns-default-metrics-tls" not found Sep 08 08:48:15.024915 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:15.024877 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:15.084420 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:15.084375 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:15.517019 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:15.516989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:18.735530 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:18.735478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:18.735965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:18.735638 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 08:48:18.735965 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:18.735706 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls podName:b4dc8f1d-a522-454e-9a6b-63decf8f371c nodeName:}" failed. No retries permitted until 2026-09-08 08:48:26.735686805 +0000 UTC m=+51.053143022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls") pod "dns-default-qhckf" (UID: "b4dc8f1d-a522-454e-9a6b-63decf8f371c") : secret "dns-default-metrics-tls" not found Sep 08 08:48:22.501272 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:22.501205 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:22.559531 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:22.559488 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:23.410502 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:23.410450 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:23.481808 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:23.481771 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:24.340612 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:24.340563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:25.596216 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.596182 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw"] Sep 08 08:48:25.652973 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.652930 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt"] Sep 08 08:48:25.653169 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.653095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" Sep 08 08:48:25.659615 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.659329 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 08 08:48:25.659615 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.659532 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 08 08:48:25.659771 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.659685 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qn5cg\"" Sep 08 08:48:25.675003 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.674962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw"] Sep 08 08:48:25.675003 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.675007 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt"] Sep 08 08:48:25.675221 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.675098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.678851 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.678819 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 08 08:48:25.679023 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.678879 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5g9vd\"" Sep 08 08:48:25.679023 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.678819 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 08:48:25.679023 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.678888 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 08:48:25.679023 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.678994 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 08 08:48:25.703620 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.703579 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-b5rbh"] Sep 08 08:48:25.718532 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.718491 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j"] Sep 08 08:48:25.718692 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.718623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.722421 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.722394 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 08 08:48:25.722910 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.722888 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 08:48:25.723032 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.722910 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 08:48:25.723032 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.722934 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-swmjp\"" Sep 08 08:48:25.723032 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.722910 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 08 08:48:25.741175 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.741139 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-b5rbh"] Sep 08 08:48:25.741390 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.741295 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:25.741390 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.741309 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 08 08:48:25.744171 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.744117 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 08 08:48:25.744494 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.744262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5j9d8\"" Sep 08 08:48:25.744494 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.744343 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 08 08:48:25.744494 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.744373 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 08 08:48:25.769441 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.769407 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j"] Sep 08 08:48:25.783263 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.783216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jx6q\" (UniqueName: \"kubernetes.io/projected/85d7825f-122f-47cf-a34c-184882f47edf-kube-api-access-2jx6q\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.783263 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.783270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.783514 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.783295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85d7825f-122f-47cf-a34c-184882f47edf-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.783514 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.783346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjqq\" (UniqueName: \"kubernetes.io/projected/0cbbac63-5578-43a4-8139-701f3406fa16-kube-api-access-9kjqq\") pod \"volume-data-source-validator-695c895bd6-5rhjw\" (UID: \"0cbbac63-5578-43a4-8139-701f3406fa16\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" Sep 08 08:48:25.884282 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfbrq\" (UniqueName: \"kubernetes.io/projected/4ef35c96-52a6-4a20-a073-503a365cfe7e-kube-api-access-vfbrq\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.884282 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ef35c96-52a6-4a20-a073-503a365cfe7e-snapshots\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.884282 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef35c96-52a6-4a20-a073-503a365cfe7e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.884282 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef35c96-52a6-4a20-a073-503a365cfe7e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jx6q\" (UniqueName: \"kubernetes.io/projected/85d7825f-122f-47cf-a34c-184882f47edf-kube-api-access-2jx6q\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef35c96-52a6-4a20-a073-503a365cfe7e-tmp\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef35c96-52a6-4a20-a073-503a365cfe7e-serving-cert\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnz7g\" (UniqueName: \"kubernetes.io/projected/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-kube-api-access-cnz7g\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85d7825f-122f-47cf-a34c-184882f47edf-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.884572 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:25.884544 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:25.884868 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:25.884615 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls podName:85d7825f-122f-47cf-a34c-184882f47edf nodeName:}" failed. No retries permitted until 2026-09-08 08:48:26.384595727 +0000 UTC m=+50.702051943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-kw4dt" (UID: "85d7825f-122f-47cf-a34c-184882f47edf") : secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:25.884868 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.884560 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjqq\" (UniqueName: \"kubernetes.io/projected/0cbbac63-5578-43a4-8139-701f3406fa16-kube-api-access-9kjqq\") pod \"volume-data-source-validator-695c895bd6-5rhjw\" (UID: \"0cbbac63-5578-43a4-8139-701f3406fa16\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" Sep 08 08:48:25.885319 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.885299 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/85d7825f-122f-47cf-a34c-184882f47edf-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.898552 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.898510 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59967cd7b-q9fmz"] Sep 08 08:48:25.902508 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.902456 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jx6q\" (UniqueName: \"kubernetes.io/projected/85d7825f-122f-47cf-a34c-184882f47edf-kube-api-access-2jx6q\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:25.903229 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.903205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjqq\" (UniqueName: \"kubernetes.io/projected/0cbbac63-5578-43a4-8139-701f3406fa16-kube-api-access-9kjqq\") pod \"volume-data-source-validator-695c895bd6-5rhjw\" (UID: \"0cbbac63-5578-43a4-8139-701f3406fa16\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" Sep 08 08:48:25.917224 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.917184 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c55f786f4-nxzlc"] Sep 08 08:48:25.917412 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.917336 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:25.919814 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.919788 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl6tk\"" Sep 08 08:48:25.919814 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.919791 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 08:48:25.920361 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.920310 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 08:48:25.920495 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.920361 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 08:48:25.930593 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.930537 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59967cd7b-q9fmz"] Sep 08 08:48:25.930997 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.930977 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c55f786f4-nxzlc"] Sep 08 08:48:25.931083 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.931002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:25.931132 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.931112 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 08:48:25.933555 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933522 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 08 08:48:25.933764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933613 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 08 08:48:25.933764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933622 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 08 08:48:25.933764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933679 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lktvf\"" Sep 08 08:48:25.933764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933688 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 08 08:48:25.933764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933628 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 08 08:48:25.933764 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.933725 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 08 08:48:25.962450 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.962409 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" Sep 08 08:48:25.985238 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfbrq\" (UniqueName: \"kubernetes.io/projected/4ef35c96-52a6-4a20-a073-503a365cfe7e-kube-api-access-vfbrq\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.985238 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ef35c96-52a6-4a20-a073-503a365cfe7e-snapshots\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef35c96-52a6-4a20-a073-503a365cfe7e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef35c96-52a6-4a20-a073-503a365cfe7e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef35c96-52a6-4a20-a073-503a365cfe7e-tmp\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef35c96-52a6-4a20-a073-503a365cfe7e-serving-cert\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.985440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnz7g\" (UniqueName: \"kubernetes.io/projected/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-kube-api-access-cnz7g\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:25.985588 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:25.985493 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 08:48:25.985952 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:25.985601 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls podName:09bd8521-7cc8-4d9c-8c4f-23216ebd2745 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:26.485577521 +0000 UTC m=+50.803033731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pbw9j" (UID: "09bd8521-7cc8-4d9c-8c4f-23216ebd2745") : secret "samples-operator-tls" not found Sep 08 08:48:25.986164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.986139 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ef35c96-52a6-4a20-a073-503a365cfe7e-tmp\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.986292 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.986228 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef35c96-52a6-4a20-a073-503a365cfe7e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.986292 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.986252 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4ef35c96-52a6-4a20-a073-503a365cfe7e-snapshots\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.986559 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.986540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef35c96-52a6-4a20-a073-503a365cfe7e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.988188 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.988164 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ef35c96-52a6-4a20-a073-503a365cfe7e-serving-cert\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:25.997579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.997542 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnz7g\" (UniqueName: \"kubernetes.io/projected/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-kube-api-access-cnz7g\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:25.998055 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:25.998030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfbrq\" (UniqueName: \"kubernetes.io/projected/4ef35c96-52a6-4a20-a073-503a365cfe7e-kube-api-access-vfbrq\") pod \"insights-operator-76bcd6ccf5-b5rbh\" (UID: \"4ef35c96-52a6-4a20-a073-503a365cfe7e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:26.028512 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.028472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" Sep 08 08:48:26.038056 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.038007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:26.086648 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-trusted-ca\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.086648 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-image-registry-private-configuration\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.086648 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-installation-pull-secrets\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsdnl\" (UniqueName: \"kubernetes.io/projected/cf2212f1-f58b-4af1-a6d6-0136f525940e-kube-api-access-zsdnl\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-stats-auth\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8h8\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-kube-api-access-8w8h8\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086803 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-default-certificate\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-bound-sa-token\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-certificates\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.087037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.086983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d224a77b-505b-4159-b83f-3d1396f77ec0-ca-trust-extracted\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.118308 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.118274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:26.187406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-image-registry-private-configuration\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.187406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-installation-pull-secrets\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.187406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.187406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsdnl\" (UniqueName: \"kubernetes.io/projected/cf2212f1-f58b-4af1-a6d6-0136f525940e-kube-api-access-zsdnl\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.187534 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:26.687507769 +0000 UTC m=+51.004963985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : configmap references non-existent config key: service-ca.crt Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.187576 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.187592 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59967cd7b-q9fmz: secret "image-registry-tls" not found Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.187637 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls podName:d224a77b-505b-4159-b83f-3d1396f77ec0 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:26.687621428 +0000 UTC m=+51.005077643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls") pod "image-registry-59967cd7b-q9fmz" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0") : secret "image-registry-tls" not found Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-stats-auth\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8h8\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-kube-api-access-8w8h8\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-default-certificate\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.187732 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-bound-sa-token\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.188221 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187800 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-certificates\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.188221 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.188221 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d224a77b-505b-4159-b83f-3d1396f77ec0-ca-trust-extracted\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.188221 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.187952 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-trusted-ca\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.188221 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.188099 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 08:48:26.188221 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.188147 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:26.688133939 +0000 UTC m=+51.005590150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : secret "router-metrics-certs-default" not found Sep 08 08:48:26.188522 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.188412 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d224a77b-505b-4159-b83f-3d1396f77ec0-ca-trust-extracted\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.188817 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.188683 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-certificates\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.189334 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.189296 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-trusted-ca\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.190517 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.190492 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-image-registry-private-configuration\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.190599 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.190524 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-stats-auth\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.191072 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.191047 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-installation-pull-secrets\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.191163 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.191095 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-default-certificate\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.195948 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.195920 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8h8\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-kube-api-access-8w8h8\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.195948 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.195939 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-bound-sa-token\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.196104 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.195971 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsdnl\" (UniqueName: \"kubernetes.io/projected/cf2212f1-f58b-4af1-a6d6-0136f525940e-kube-api-access-zsdnl\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.240339 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.240302 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw"] Sep 08 08:48:26.243600 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:26.243565 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbbac63_5578_43a4_8139_701f3406fa16.slice/crio-b9d4988bb133fdc2e5a4addfffcc93095b803558e2412b5ce86f71f52b4a9c29 WatchSource:0}: Error finding container b9d4988bb133fdc2e5a4addfffcc93095b803558e2412b5ce86f71f52b4a9c29: Status 404 returned error can't find the container with id b9d4988bb133fdc2e5a4addfffcc93095b803558e2412b5ce86f71f52b4a9c29 Sep 08 08:48:26.318765 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.318712 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-b5rbh"] Sep 08 08:48:26.322736 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:26.322707 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef35c96_52a6_4a20_a073_503a365cfe7e.slice/crio-ef5b895f6a4fd15595d9371bfa46bbe0631b74af7d0a2132567975953f655453 WatchSource:0}: Error finding container ef5b895f6a4fd15595d9371bfa46bbe0631b74af7d0a2132567975953f655453: Status 404 returned error can't find the container with id ef5b895f6a4fd15595d9371bfa46bbe0631b74af7d0a2132567975953f655453 Sep 08 08:48:26.390191 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.390143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:26.390375 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.390303 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:26.390411 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.390378 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls podName:85d7825f-122f-47cf-a34c-184882f47edf nodeName:}" failed. No retries permitted until 2026-09-08 08:48:27.390359451 +0000 UTC m=+51.707815662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-kw4dt" (UID: "85d7825f-122f-47cf-a34c-184882f47edf") : secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:26.490962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.490871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:26.491112 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.490990 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 08:48:26.491112 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.491046 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls podName:09bd8521-7cc8-4d9c-8c4f-23216ebd2745 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:27.491033261 +0000 UTC m=+51.808489456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pbw9j" (UID: "09bd8521-7cc8-4d9c-8c4f-23216ebd2745") : secret "samples-operator-tls" not found Sep 08 08:48:26.577720 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.577674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" event={"ID":"4ef35c96-52a6-4a20-a073-503a365cfe7e","Type":"ContainerStarted","Data":"ef5b895f6a4fd15595d9371bfa46bbe0631b74af7d0a2132567975953f655453"} Sep 08 08:48:26.578875 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.578847 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" event={"ID":"0cbbac63-5578-43a4-8139-701f3406fa16","Type":"ContainerStarted","Data":"b9d4988bb133fdc2e5a4addfffcc93095b803558e2412b5ce86f71f52b4a9c29"} Sep 08 08:48:26.692512 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.692458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.692512 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.692515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.692555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.692673 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.692675 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:27.69264927 +0000 UTC m=+52.010105490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : configmap references non-existent config key: service-ca.crt Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.692691 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.692706 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59967cd7b-q9fmz: secret "image-registry-tls" not found Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.692714 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:27.692702548 +0000 UTC m=+52.010158744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : secret "router-metrics-certs-default" not found Sep 08 08:48:26.693004 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.692767 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls podName:d224a77b-505b-4159-b83f-3d1396f77ec0 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:27.692731699 +0000 UTC m=+52.010187912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls") pod "image-registry-59967cd7b-q9fmz" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0") : secret "image-registry-tls" not found Sep 08 08:48:26.793567 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:26.793509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:26.793767 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.793668 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 08:48:26.793767 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:26.793759 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls podName:b4dc8f1d-a522-454e-9a6b-63decf8f371c nodeName:}" failed. No retries permitted until 2026-09-08 08:48:42.793725937 +0000 UTC m=+67.111182157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls") pod "dns-default-qhckf" (UID: "b4dc8f1d-a522-454e-9a6b-63decf8f371c") : secret "dns-default-metrics-tls" not found Sep 08 08:48:27.400956 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:27.400907 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:27.401164 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.401055 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:27.401164 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.401146 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls podName:85d7825f-122f-47cf-a34c-184882f47edf nodeName:}" failed. No retries permitted until 2026-09-08 08:48:29.401124115 +0000 UTC m=+53.718580330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-kw4dt" (UID: "85d7825f-122f-47cf-a34c-184882f47edf") : secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:27.502423 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:27.502366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:27.502610 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.502522 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 08:48:27.502666 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.502616 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls podName:09bd8521-7cc8-4d9c-8c4f-23216ebd2745 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:29.502595323 +0000 UTC m=+53.820051562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pbw9j" (UID: "09bd8521-7cc8-4d9c-8c4f-23216ebd2745") : secret "samples-operator-tls" not found Sep 08 08:48:27.705319 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:27.705213 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:27.705319 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:27.705278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:27.705319 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:27.705315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:27.705931 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.705402 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:29.705381837 +0000 UTC m=+54.022838066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : configmap references non-existent config key: service-ca.crt Sep 08 08:48:27.705931 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.705468 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 08:48:27.705931 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.705485 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 08:48:27.705931 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.705491 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59967cd7b-q9fmz: secret "image-registry-tls" not found Sep 08 08:48:27.705931 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.705533 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:29.705518459 +0000 UTC m=+54.022974767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : secret "router-metrics-certs-default" not found Sep 08 08:48:27.705931 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:27.705547 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls podName:d224a77b-505b-4159-b83f-3d1396f77ec0 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:29.705540382 +0000 UTC m=+54.022996578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls") pod "image-registry-59967cd7b-q9fmz" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0") : secret "image-registry-tls" not found Sep 08 08:48:28.586185 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:28.586134 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" event={"ID":"0cbbac63-5578-43a4-8139-701f3406fa16","Type":"ContainerStarted","Data":"4c069a98c4632049b2ffa37867d956e4e720e6dddbf9057498c4c4909abaebf3"} Sep 08 08:48:28.601073 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:28.601013 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5rhjw" podStartSLOduration=2.097271149 podStartE2EDuration="3.600994207s" totalImagesPullingTime="1.503723058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:28.600141044 +0000 UTC m=+52.917597275" watchObservedRunningTime="2026-09-08 08:48:28.600994207 +0000 UTC m=+52.918450424" Sep 08 08:48:28.705802 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:28.705759 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:28.806398 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:28.806297 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:29.423809 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.423762 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:29.424129 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.423933 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:29.424129 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.424010 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls podName:85d7825f-122f-47cf-a34c-184882f47edf nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.423993233 +0000 UTC m=+57.741449429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-kw4dt" (UID: "85d7825f-122f-47cf-a34c-184882f47edf") : secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:29.524404 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.524355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:29.524630 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.524506 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 08:48:29.524630 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.524575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls podName:09bd8521-7cc8-4d9c-8c4f-23216ebd2745 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.524556619 +0000 UTC m=+57.842012815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pbw9j" (UID: "09bd8521-7cc8-4d9c-8c4f-23216ebd2745") : secret "samples-operator-tls" not found Sep 08 08:48:29.590839 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.590803 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" event={"ID":"4ef35c96-52a6-4a20-a073-503a365cfe7e","Type":"ContainerStarted","Data":"954313dfd6eda9565b998fb4e1b1a42088be7e3748b303cc151f049747cb977c"} Sep 08 08:48:29.607568 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.607505 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" podStartSLOduration=2.325112232 podStartE2EDuration="4.607488626s" totalImagesPullingTime="2.282376394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:29.606427084 +0000 UTC m=+53.923883295" watchObservedRunningTime="2026-09-08 08:48:29.607488626 +0000 UTC m=+53.924944835" Sep 08 08:48:29.725857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.725726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:29.725857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.725814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:29.725857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.725855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:29.726422 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.725913 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.725888528 +0000 UTC m=+58.043344745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : configmap references non-existent config key: service-ca.crt Sep 08 08:48:29.726422 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.725975 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 08:48:29.726422 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.725980 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 08:48:29.726422 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.726026 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.72601043 +0000 UTC m=+58.043466650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : secret "router-metrics-certs-default" not found Sep 08 08:48:29.726422 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.726039 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59967cd7b-q9fmz: secret "image-registry-tls" not found Sep 08 08:48:29.726422 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:29.726122 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls podName:d224a77b-505b-4159-b83f-3d1396f77ec0 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.726100883 +0000 UTC m=+58.043557107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls") pod "image-registry-59967cd7b-q9fmz" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0") : secret "image-registry-tls" not found Sep 08 08:48:29.938460 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.938420 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-knr98"] Sep 08 08:48:29.942048 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.942022 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:29.944311 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.944278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 08:48:29.944503 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.944402 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjzgc\"" Sep 08 08:48:29.944561 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.944513 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 08:48:29.953218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.953124 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-knr98"] Sep 08 08:48:29.957026 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:29.956985 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:30.017913 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.017879 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:30.129531 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.129497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chg5m\" (UniqueName: \"kubernetes.io/projected/13f80f01-4025-4197-9ed4-1fb449913610-kube-api-access-chg5m\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.129726 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.129556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.129726 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.129715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13f80f01-4025-4197-9ed4-1fb449913610-data-volume\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.129853 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.129795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.129853 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.129819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13f80f01-4025-4197-9ed4-1fb449913610-crio-socket\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230170 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230170 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13f80f01-4025-4197-9ed4-1fb449913610-crio-socket\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230379 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chg5m\" (UniqueName: \"kubernetes.io/projected/13f80f01-4025-4197-9ed4-1fb449913610-kube-api-access-chg5m\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230379 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.230258 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 08:48:30.230379 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.230328 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:30.730312583 +0000 UTC m=+55.047768800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : configmap "kube-rbac-proxy" not found Sep 08 08:48:30.230379 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230262 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230563 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.230425 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 08:48:30.230563 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13f80f01-4025-4197-9ed4-1fb449913610-data-volume\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230563 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230463 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/13f80f01-4025-4197-9ed4-1fb449913610-crio-socket\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.230563 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.230470 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:30.730457856 +0000 UTC m=+55.047914081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : secret "insights-runtime-extractor-tls" not found Sep 08 08:48:30.230713 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.230697 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/13f80f01-4025-4197-9ed4-1fb449913610-data-volume\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.238785 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.238732 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chg5m\" (UniqueName: \"kubernetes.io/projected/13f80f01-4025-4197-9ed4-1fb449913610-kube-api-access-chg5m\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.735599 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.735563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.736128 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.735800 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 08:48:30.736128 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:30.735864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:30.736128 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.735925 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 08:48:30.736128 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.735948 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:31.735925766 +0000 UTC m=+56.053381963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : configmap "kube-rbac-proxy" not found Sep 08 08:48:30.736128 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:30.736005 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:31.735981252 +0000 UTC m=+56.053437464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : secret "insights-runtime-extractor-tls" not found Sep 08 08:48:31.310670 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.310643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cgbf_3fc98736-1625-4178-898d-173379416c5b/dns-node-resolver/0.log" Sep 08 08:48:31.378790 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.378728 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:31.464738 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.464698 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:31.536028 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.535978 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:31.746676 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.746567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:31.747146 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.746780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:31.747146 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:31.746788 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 08:48:31.747146 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:31.746945 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.746928488 +0000 UTC m=+58.064384697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : secret "insights-runtime-extractor-tls" not found Sep 08 08:48:31.747146 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:31.746833 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 08:48:31.747146 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:31.747004 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:33.746991403 +0000 UTC m=+58.064447612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : configmap "kube-rbac-proxy" not found Sep 08 08:48:31.861454 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.861400 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:31.916554 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:31.916513 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:32.281438 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:32.281387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:32.673644 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:32.673552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:32.705761 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:32.705714 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q78xr_d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf/node-ca/0.log" Sep 08 08:48:33.040585 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.040529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:33.308499 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.308410 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxt2r_fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4/serve-healthcheck-canary/0.log" Sep 08 08:48:33.394623 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.394590 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:33.465040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.464994 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:33.465226 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.465149 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:33.465269 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.465231 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls podName:85d7825f-122f-47cf-a34c-184882f47edf nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.465211697 +0000 UTC m=+65.782667892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-kw4dt" (UID: "85d7825f-122f-47cf-a34c-184882f47edf") : secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:33.469839 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.469801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:33.565896 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.565769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:33.566079 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.565891 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 08:48:33.566079 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.565977 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls podName:09bd8521-7cc8-4d9c-8c4f-23216ebd2745 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.565959574 +0000 UTC m=+65.883415795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-pbw9j" (UID: "09bd8521-7cc8-4d9c-8c4f-23216ebd2745") : secret "samples-operator-tls" not found Sep 08 08:48:33.707872 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.707834 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:33.767268 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.767235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:33.767268 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.767273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:33.767481 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.767358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:33.767481 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.767382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:33.767481 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767388 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 08:48:33.767481 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767454 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 08:48:33.767481 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767472 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767482 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.767463356 +0000 UTC m=+66.084919562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : secret "router-metrics-certs-default" not found Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:33.767452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767513 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:37.767495837 +0000 UTC m=+62.084952050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : configmap "kube-rbac-proxy" not found Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767550 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767560 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59967cd7b-q9fmz: secret "image-registry-tls" not found Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767583 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:37.767536803 +0000 UTC m=+62.084993015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : secret "insights-runtime-extractor-tls" not found Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767616 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.767603537 +0000 UTC m=+66.085059738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : configmap references non-existent config key: service-ca.crt Sep 08 08:48:33.767707 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:33.767646 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls podName:d224a77b-505b-4159-b83f-3d1396f77ec0 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:41.767633299 +0000 UTC m=+66.085089509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls") pod "image-registry-59967cd7b-q9fmz" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0") : secret "image-registry-tls" not found Sep 08 08:48:34.163969 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.163931 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hbvz8"] Sep 08 08:48:34.195106 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.195060 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hbvz8"] Sep 08 08:48:34.195313 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.195192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.197869 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.197839 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 08 08:48:34.198661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.198621 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 08 08:48:34.198661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.198654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 08 08:48:34.198893 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.198706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qrnct\"" Sep 08 08:48:34.198893 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.198621 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 08 08:48:34.199511 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.199486 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:34.271251 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.271201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-signing-cabundle\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.271437 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.271291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-signing-key\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.271437 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.271408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7jnx\" (UniqueName: \"kubernetes.io/projected/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-kube-api-access-p7jnx\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.299984 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.299939 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:34.372055 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.372014 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7jnx\" (UniqueName: \"kubernetes.io/projected/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-kube-api-access-p7jnx\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.372189 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.372118 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-signing-cabundle\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.372189 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.372166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-signing-key\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.372923 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.372898 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-signing-cabundle\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.374718 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.374691 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-signing-key\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.381072 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.381035 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7jnx\" (UniqueName: \"kubernetes.io/projected/bc07df90-d9f7-43e4-a57f-e7092ad6d5a6-kube-api-access-p7jnx\") pod \"service-ca-75d99c484-hbvz8\" (UID: \"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6\") " pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.505471 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.505380 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-hbvz8" Sep 08 08:48:34.795398 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:34.795360 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-hbvz8"] Sep 08 08:48:35.598310 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:35.598270 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:35.608161 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:35.608127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hbvz8" event={"ID":"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6","Type":"ContainerStarted","Data":"6c23b5d8320d85501782f29ab70318be73f0b187f9deb7771f1834632fd13338"} Sep 08 08:48:36.522948 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:36.522912 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6zpw" Sep 08 08:48:37.614529 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:37.614491 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-hbvz8" event={"ID":"bc07df90-d9f7-43e4-a57f-e7092ad6d5a6","Type":"ContainerStarted","Data":"549e120e5f6284ffe21840b748b3ecf2479921184608c4a8af3d1885ff960196"} Sep 08 08:48:37.631923 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:37.631812 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-hbvz8" podStartSLOduration=1.830479915 podStartE2EDuration="3.631792256s" totalImagesPullingTime="1.801312341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:37.631036179 +0000 UTC m=+61.948492396" watchObservedRunningTime="2026-09-08 08:48:37.631792256 +0000 UTC m=+61.949248473" Sep 08 08:48:37.800538 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:37.800491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:37.800759 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:37.800622 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:37.800759 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:37.800658 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 08:48:37.800879 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:37.800761 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:45.800723735 +0000 UTC m=+70.118179935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : secret "insights-runtime-extractor-tls" not found Sep 08 08:48:37.800879 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:37.800766 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 08:48:37.800879 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:37.800838 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:48:45.80081988 +0000 UTC m=+70.118276090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : configmap "kube-rbac-proxy" not found Sep 08 08:48:37.942784 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:37.942643 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.041704 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.041653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.142628 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.142591 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.242579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.242477 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.350852 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.350814 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.452738 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.452690 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.661838 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.661802 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:38.870618 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:38.870583 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:39.447438 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:39.447397 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:39.843808 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:39.843765 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:39.919876 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:39.919837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:40.045862 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:40.045826 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:40.240780 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:40.240666 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:40.445139 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:40.445099 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:40.649499 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:40.649462 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:40.750855 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:40.750822 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:41.536025 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.535968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:41.536473 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.536123 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:41.536473 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.536194 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls podName:85d7825f-122f-47cf-a34c-184882f47edf nodeName:}" failed. No retries permitted until 2026-09-08 08:48:57.536176431 +0000 UTC m=+81.853632643 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-kw4dt" (UID: "85d7825f-122f-47cf-a34c-184882f47edf") : secret "cluster-monitoring-operator-tls" not found Sep 08 08:48:41.548539 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.548499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:41.637267 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.637218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:41.639802 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.639771 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/09bd8521-7cc8-4d9c-8c4f-23216ebd2745-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-pbw9j\" (UID: \"09bd8521-7cc8-4d9c-8c4f-23216ebd2745\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:41.649794 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.649739 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:41.663854 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.663810 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5j9d8\"" Sep 08 08:48:41.671629 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.671598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" Sep 08 08:48:41.750477 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.750437 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:41.839569 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.839457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:41.839774 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.839591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:41.839774 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.839618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:41.839774 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.839632 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 08 08:48:41.839774 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.839713 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:57.839692905 +0000 UTC m=+82.157149120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : secret "router-metrics-certs-default" not found Sep 08 08:48:41.839991 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.839776 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle podName:cf2212f1-f58b-4af1-a6d6-0136f525940e nodeName:}" failed. No retries permitted until 2026-09-08 08:48:57.839733783 +0000 UTC m=+82.157190005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle") pod "router-default-6c55f786f4-nxzlc" (UID: "cf2212f1-f58b-4af1-a6d6-0136f525940e") : configmap references non-existent config key: service-ca.crt Sep 08 08:48:41.842039 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.842006 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"image-registry-59967cd7b-q9fmz\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:41.850333 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.850294 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:41.940659 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.940613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:41.940659 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.940661 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:41.940946 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.940690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:48:41.943582 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.943561 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 08:48:41.943636 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.943582 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 08:48:41.943677 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.943561 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 08:48:41.951508 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.951470 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 08:48:41.951634 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:41.951581 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs podName:030a7a26-d668-4f3f-8078-b7ed24dab6fc nodeName:}" failed. No retries permitted until 2026-09-08 08:49:45.951558781 +0000 UTC m=+130.269014997 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs") pod "network-metrics-daemon-krcc8" (UID: "030a7a26-d668-4f3f-8078-b7ed24dab6fc") : secret "metrics-daemon-secret" not found Sep 08 08:48:41.953734 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.953703 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16461164-6c50-4205-9337-d87538d7516f-original-pull-secret\") pod \"global-pull-secret-syncer-s4s94\" (UID: \"16461164-6c50-4205-9337-d87538d7516f\") " pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:41.953918 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.953900 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 08:48:41.964432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.964395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtv85\" (UniqueName: \"kubernetes.io/projected/ebae9480-b9a6-479e-9e97-521e48b4ea98-kube-api-access-xtv85\") pod \"network-check-target-cb5sh\" (UID: \"ebae9480-b9a6-479e-9e97-521e48b4ea98\") " pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:41.982606 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:41.982570 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j"] Sep 08 08:48:42.132162 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.132072 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kl6tk\"" Sep 08 08:48:42.139996 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.139959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:42.221537 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.221502 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d8k6z\"" Sep 08 08:48:42.224912 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.224728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4s94" Sep 08 08:48:42.229934 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.229901 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:42.238536 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.238471 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:42.429781 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.429640 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59967cd7b-q9fmz"] Sep 08 08:48:42.432242 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:42.432212 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd224a77b_505b_4159_b83f_3d1396f77ec0.slice/crio-502d26ded840701c2f1916778a083c429564d059d3a1340324719670fc18bf2b WatchSource:0}: Error finding container 502d26ded840701c2f1916778a083c429564d059d3a1340324719670fc18bf2b: Status 404 returned error can't find the container with id 502d26ded840701c2f1916778a083c429564d059d3a1340324719670fc18bf2b Sep 08 08:48:42.437572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.437537 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:42.499018 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.498974 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:42.511264 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.507343 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4s94"] Sep 08 08:48:42.511264 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.510152 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cb5sh"] Sep 08 08:48:42.516534 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:42.516502 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebae9480_b9a6_479e_9e97_521e48b4ea98.slice/crio-0619b4bfe523a2ae41383884297faacfb3353510b4e8ae5618600d86e805f60d WatchSource:0}: Error finding container 0619b4bfe523a2ae41383884297faacfb3353510b4e8ae5618600d86e805f60d: Status 404 returned error can't find the container with id 0619b4bfe523a2ae41383884297faacfb3353510b4e8ae5618600d86e805f60d Sep 08 08:48:42.630883 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.630832 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cb5sh" event={"ID":"ebae9480-b9a6-479e-9e97-521e48b4ea98","Type":"ContainerStarted","Data":"0619b4bfe523a2ae41383884297faacfb3353510b4e8ae5618600d86e805f60d"} Sep 08 08:48:42.632415 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.632382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4s94" event={"ID":"16461164-6c50-4205-9337-d87538d7516f","Type":"ContainerStarted","Data":"fcbe1fb9666d4d534e369da38b3edba8a528c46c2f3b422dd9747665cf850ee6"} Sep 08 08:48:42.633804 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.633768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" event={"ID":"09bd8521-7cc8-4d9c-8c4f-23216ebd2745","Type":"ContainerStarted","Data":"2485c2a2f82b045447da0a542c2e737aeb75e7e5943138a81e6df542453c3cbe"} Sep 08 08:48:42.635836 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.635785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" event={"ID":"d224a77b-505b-4159-b83f-3d1396f77ec0","Type":"ContainerStarted","Data":"b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f"} Sep 08 08:48:42.635836 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.635830 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" event={"ID":"d224a77b-505b-4159-b83f-3d1396f77ec0","Type":"ContainerStarted","Data":"502d26ded840701c2f1916778a083c429564d059d3a1340324719670fc18bf2b"} Sep 08 08:48:42.635991 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.635975 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:48:42.657156 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.657091 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" podStartSLOduration=17.657067297 podStartE2EDuration="17.657067297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:42.656781016 +0000 UTC m=+66.974237234" watchObservedRunningTime="2026-09-08 08:48:42.657067297 +0000 UTC m=+66.974523518" Sep 08 08:48:42.848523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.848464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:42.852329 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.852252 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4dc8f1d-a522-454e-9a6b-63decf8f371c-metrics-tls\") pod \"dns-default-qhckf\" (UID: \"b4dc8f1d-a522-454e-9a6b-63decf8f371c\") " pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:42.889419 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:42.889373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:43.092091 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:43.092045 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:43.128379 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:43.128295 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pkgjn\"" Sep 08 08:48:43.136639 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:43.136595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:43.430007 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:43.429916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhckf"] Sep 08 08:48:43.642003 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:43.641953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:43.841786 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:43.841019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:43.928392 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:43.928346 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4dc8f1d_a522_454e_9a6b_63decf8f371c.slice/crio-5e83b36cbf869be8156241c61444677b34f1c49c34dc3866be2c32d6ebfa93e0 WatchSource:0}: Error finding container 5e83b36cbf869be8156241c61444677b34f1c49c34dc3866be2c32d6ebfa93e0: Status 404 returned error can't find the container with id 5e83b36cbf869be8156241c61444677b34f1c49c34dc3866be2c32d6ebfa93e0 Sep 08 08:48:44.037908 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.037813 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:44.225763 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.225448 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:44.325312 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.325243 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:44.650208 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.650169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" event={"ID":"09bd8521-7cc8-4d9c-8c4f-23216ebd2745","Type":"ContainerStarted","Data":"b27abded2ff6f2bf41d657aa1d6a99141e249344a0b68311ddea7cf515146e51"} Sep 08 08:48:44.650705 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.650242 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" event={"ID":"09bd8521-7cc8-4d9c-8c4f-23216ebd2745","Type":"ContainerStarted","Data":"af01ace93b4c695cc48cc7d79c7e76930083a9d6ec4dbb4d21258ca2d532c2ac"} Sep 08 08:48:44.652917 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.652874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhckf" event={"ID":"b4dc8f1d-a522-454e-9a6b-63decf8f371c","Type":"ContainerStarted","Data":"5e83b36cbf869be8156241c61444677b34f1c49c34dc3866be2c32d6ebfa93e0"} Sep 08 08:48:44.671050 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:44.669654 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-pbw9j" podStartSLOduration=17.716002236 podStartE2EDuration="19.669628451s" totalImagesPullingTime="1.953626215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:44.669101681 +0000 UTC m=+68.986557899" watchObservedRunningTime="2026-09-08 08:48:44.669628451 +0000 UTC m=+68.987084670" Sep 08 08:48:45.029382 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.029342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:45.128772 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.128717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:45.246183 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.246147 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:45.640564 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.640520 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:45.844186 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.844137 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:45.881631 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.881596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:45.881857 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:45.881791 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 08:48:45.881939 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:48:45.881871 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls podName:13f80f01-4025-4197-9ed4-1fb449913610 nodeName:}" failed. No retries permitted until 2026-09-08 08:49:01.881847092 +0000 UTC m=+86.199303289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls") pod "insights-runtime-extractor-knr98" (UID: "13f80f01-4025-4197-9ed4-1fb449913610") : secret "insights-runtime-extractor-tls" not found Sep 08 08:48:45.881939 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.881787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:45.882298 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:45.882273 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/13f80f01-4025-4197-9ed4-1fb449913610-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:48:46.069520 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:46.069441 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:46.238103 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:46.238061 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:47.360766 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:47.360701 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:47.447487 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:47.447454 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:47.656785 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:47.656677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:47.838940 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:47.838904 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:48.043629 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.043595 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:48.252495 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.252461 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:48.646439 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.646342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:48.672724 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.672683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cb5sh" event={"ID":"ebae9480-b9a6-479e-9e97-521e48b4ea98","Type":"ContainerStarted","Data":"880ef6f42ca255d62cd5668844893aad504920f888457a4b15687007d3956448"} Sep 08 08:48:48.672951 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.672900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:48:48.674489 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.674455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4s94" event={"ID":"16461164-6c50-4205-9337-d87538d7516f","Type":"ContainerStarted","Data":"f860f3e270ad33be0c9af69e05d439a0c09cd764cd2000bc38c32d4a52612f07"} Sep 08 08:48:48.676371 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.676342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhckf" event={"ID":"b4dc8f1d-a522-454e-9a6b-63decf8f371c","Type":"ContainerStarted","Data":"ef6cf34ea6220625885fe7505516563bb410de6a1436b0c15ae4a2d1bbc57091"} Sep 08 08:48:48.676507 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.676394 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhckf" event={"ID":"b4dc8f1d-a522-454e-9a6b-63decf8f371c","Type":"ContainerStarted","Data":"417a1c2fa86b823ea32460bf0df1e073bef5fef7ac2ef1a396c8938eca996ee0"} Sep 08 08:48:48.676507 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.676475 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:48.688820 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.688764 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cb5sh" podStartSLOduration=66.936988277 podStartE2EDuration="1m12.688731471s" totalImagesPullingTime="5.751743194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:48.688506267 +0000 UTC m=+73.005962486" watchObservedRunningTime="2026-09-08 08:48:48.688731471 +0000 UTC m=+73.006187688" Sep 08 08:48:48.705118 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.705049 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s4s94" podStartSLOduration=66.943698496 podStartE2EDuration="1m12.70502527s" totalImagesPullingTime="5.761326774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:48.703645837 +0000 UTC m=+73.021102056" watchObservedRunningTime="2026-09-08 08:48:48.70502527 +0000 UTC m=+73.022481489" Sep 08 08:48:48.725825 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:48.725761 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qhckf" podStartSLOduration=34.397832676 podStartE2EDuration="38.725723256s" totalImagesPullingTime="4.32789058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:48.724995792 +0000 UTC m=+73.042452012" watchObservedRunningTime="2026-09-08 08:48:48.725723256 +0000 UTC m=+73.043179532" Sep 08 08:48:56.258192 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.258149 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59967cd7b-q9fmz"] Sep 08 08:48:56.347918 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.347881 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74c598bc86-g59qs"] Sep 08 08:48:56.350850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.350824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.366860 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.366829 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74c598bc86-g59qs"] Sep 08 08:48:56.368596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.368562 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:56.463925 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.463889 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:56.474280 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97962ca3-8377-4406-9a63-38d0506e77d4-trusted-ca\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474408 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-registry-tls\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474408 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-bound-sa-token\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474408 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97962ca3-8377-4406-9a63-38d0506e77d4-image-registry-private-configuration\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97962ca3-8377-4406-9a63-38d0506e77d4-installation-pull-secrets\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97962ca3-8377-4406-9a63-38d0506e77d4-ca-trust-extracted\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97962ca3-8377-4406-9a63-38d0506e77d4-registry-certificates\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.474523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.474514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwr9d\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-kube-api-access-lwr9d\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575424 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwr9d\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-kube-api-access-lwr9d\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575605 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97962ca3-8377-4406-9a63-38d0506e77d4-trusted-ca\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575674 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-registry-tls\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575728 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-bound-sa-token\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575826 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97962ca3-8377-4406-9a63-38d0506e77d4-image-registry-private-configuration\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575826 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97962ca3-8377-4406-9a63-38d0506e77d4-installation-pull-secrets\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575926 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97962ca3-8377-4406-9a63-38d0506e77d4-ca-trust-extracted\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.575926 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.575882 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97962ca3-8377-4406-9a63-38d0506e77d4-registry-certificates\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.576321 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.576260 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97962ca3-8377-4406-9a63-38d0506e77d4-ca-trust-extracted\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.576823 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.576669 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:56.576823 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.576757 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97962ca3-8377-4406-9a63-38d0506e77d4-trusted-ca\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.577015 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.576826 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97962ca3-8377-4406-9a63-38d0506e77d4-registry-certificates\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.578556 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.578528 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97962ca3-8377-4406-9a63-38d0506e77d4-image-registry-private-configuration\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.578664 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.578541 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-registry-tls\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.578664 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.578632 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97962ca3-8377-4406-9a63-38d0506e77d4-installation-pull-secrets\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.590694 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.590650 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-bound-sa-token\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.598203 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.598170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwr9d\" (UniqueName: \"kubernetes.io/projected/97962ca3-8377-4406-9a63-38d0506e77d4-kube-api-access-lwr9d\") pod \"image-registry-74c598bc86-g59qs\" (UID: \"97962ca3-8377-4406-9a63-38d0506e77d4\") " pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.661085 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.661044 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:56.668387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.668357 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:48:56.946009 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:56.945958 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74c598bc86-g59qs"] Sep 08 08:48:56.948770 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:56.948723 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97962ca3_8377_4406_9a63_38d0506e77d4.slice/crio-740f990f88f82ce74eaaf1a887b70afac7742a477a972911a90374da32c5ef4a WatchSource:0}: Error finding container 740f990f88f82ce74eaaf1a887b70afac7742a477a972911a90374da32c5ef4a: Status 404 returned error can't find the container with id 740f990f88f82ce74eaaf1a887b70afac7742a477a972911a90374da32c5ef4a Sep 08 08:48:57.585202 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.585056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:57.587718 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.587686 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d7825f-122f-47cf-a34c-184882f47edf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-kw4dt\" (UID: \"85d7825f-122f-47cf-a34c-184882f47edf\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:57.713180 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.713141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" event={"ID":"97962ca3-8377-4406-9a63-38d0506e77d4","Type":"ContainerStarted","Data":"6ee60bc864d60b1f3ede4338c731a5cb1336c04c305faece22cce9545a233468"} Sep 08 08:48:57.713360 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.713201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" event={"ID":"97962ca3-8377-4406-9a63-38d0506e77d4","Type":"ContainerStarted","Data":"740f990f88f82ce74eaaf1a887b70afac7742a477a972911a90374da32c5ef4a"} Sep 08 08:48:57.713360 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.713272 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:48:57.733126 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.733059 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" podStartSLOduration=1.733039687 podStartE2EDuration="1.733039687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:57.732509605 +0000 UTC m=+82.049965823" watchObservedRunningTime="2026-09-08 08:48:57.733039687 +0000 UTC m=+82.050495905" Sep 08 08:48:57.787139 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.787100 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5g9vd\"" Sep 08 08:48:57.795133 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.795101 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" Sep 08 08:48:57.888323 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.888276 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:57.888518 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.888389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:57.889607 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.889569 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf2212f1-f58b-4af1-a6d6-0136f525940e-service-ca-bundle\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:57.893302 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:57.892064 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf2212f1-f58b-4af1-a6d6-0136f525940e-metrics-certs\") pod \"router-default-6c55f786f4-nxzlc\" (UID: \"cf2212f1-f58b-4af1-a6d6-0136f525940e\") " pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:58.044432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.044394 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lktvf\"" Sep 08 08:48:58.051549 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.051521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:58.070381 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.070341 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt"] Sep 08 08:48:58.073647 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:58.073616 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d7825f_122f_47cf_a34c_184882f47edf.slice/crio-642e295401c82986e15e7a6d7f3bbc07704fc9a8c2c1d3a6d2d482091e50a13e WatchSource:0}: Error finding container 642e295401c82986e15e7a6d7f3bbc07704fc9a8c2c1d3a6d2d482091e50a13e: Status 404 returned error can't find the container with id 642e295401c82986e15e7a6d7f3bbc07704fc9a8c2c1d3a6d2d482091e50a13e Sep 08 08:48:58.331318 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.331176 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c55f786f4-nxzlc"] Sep 08 08:48:58.333714 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:48:58.333684 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2212f1_f58b_4af1_a6d6_0136f525940e.slice/crio-7898c985fa7be90d6d84e531334e88a60454c27b5bc5a9d8cfeb99932ff30eaf WatchSource:0}: Error finding container 7898c985fa7be90d6d84e531334e88a60454c27b5bc5a9d8cfeb99932ff30eaf: Status 404 returned error can't find the container with id 7898c985fa7be90d6d84e531334e88a60454c27b5bc5a9d8cfeb99932ff30eaf Sep 08 08:48:58.683408 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.683325 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qhckf" Sep 08 08:48:58.719521 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.719475 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" event={"ID":"85d7825f-122f-47cf-a34c-184882f47edf","Type":"ContainerStarted","Data":"642e295401c82986e15e7a6d7f3bbc07704fc9a8c2c1d3a6d2d482091e50a13e"} Sep 08 08:48:58.721338 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.721308 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" event={"ID":"cf2212f1-f58b-4af1-a6d6-0136f525940e","Type":"ContainerStarted","Data":"18abfc190e9fccd92aa26fe2b00e8b6fd13f3360c602320ddb77a57547185ba5"} Sep 08 08:48:58.721466 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.721349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" event={"ID":"cf2212f1-f58b-4af1-a6d6-0136f525940e","Type":"ContainerStarted","Data":"7898c985fa7be90d6d84e531334e88a60454c27b5bc5a9d8cfeb99932ff30eaf"} Sep 08 08:48:58.743034 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:58.742971 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" podStartSLOduration=33.742946731 podStartE2EDuration="33.742946731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:58.741725261 +0000 UTC m=+83.059181479" watchObservedRunningTime="2026-09-08 08:48:58.742946731 +0000 UTC m=+83.060402951" Sep 08 08:48:59.051721 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.051681 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:59.054663 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.054639 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:59.727322 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.727281 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" event={"ID":"85d7825f-122f-47cf-a34c-184882f47edf","Type":"ContainerStarted","Data":"fe7dc84d0cc320dbd59f167fcbadacc6944f7c5fcd489ab6e3f00a8dc3cd5700"} Sep 08 08:48:59.727838 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.727507 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:59.728813 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.728791 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c55f786f4-nxzlc" Sep 08 08:48:59.742802 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.742718 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-kw4dt" podStartSLOduration=33.201779946 podStartE2EDuration="34.742700878s" totalImagesPullingTime="1.540920932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:48:59.742216954 +0000 UTC m=+84.059673169" watchObservedRunningTime="2026-09-08 08:48:59.742700878 +0000 UTC m=+84.060157096" Sep 08 08:48:59.957648 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:48:59.957549 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.057282 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.057237 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.132437 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.132392 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.453012 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.452963 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.560553 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.560499 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.653209 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.653170 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.828356 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.828293 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:00.896307 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:00.896270 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:01.926650 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:01.926602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:49:01.929085 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:01.929045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/13f80f01-4025-4197-9ed4-1fb449913610-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-knr98\" (UID: \"13f80f01-4025-4197-9ed4-1fb449913610\") " pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:49:02.054787 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:02.054728 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjzgc\"" Sep 08 08:49:02.062306 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:02.062270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-knr98" Sep 08 08:49:02.340572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:02.340543 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-knr98"] Sep 08 08:49:02.343147 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:02.343105 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f80f01_4025_4197_9ed4_1fb449913610.slice/crio-29b70e80d4b2f74196245076fdf071733244293d8122d8c7fe23d327a361896d WatchSource:0}: Error finding container 29b70e80d4b2f74196245076fdf071733244293d8122d8c7fe23d327a361896d: Status 404 returned error can't find the container with id 29b70e80d4b2f74196245076fdf071733244293d8122d8c7fe23d327a361896d Sep 08 08:49:02.739114 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:02.739034 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knr98" event={"ID":"13f80f01-4025-4197-9ed4-1fb449913610","Type":"ContainerStarted","Data":"66f206eba22c5e4d36f74e0ab294899d830cc7bd21bedb87351b00fa97844bfc"} Sep 08 08:49:02.739114 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:02.739095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knr98" event={"ID":"13f80f01-4025-4197-9ed4-1fb449913610","Type":"ContainerStarted","Data":"29b70e80d4b2f74196245076fdf071733244293d8122d8c7fe23d327a361896d"} Sep 08 08:49:03.744342 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:03.744252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knr98" event={"ID":"13f80f01-4025-4197-9ed4-1fb449913610","Type":"ContainerStarted","Data":"9152c53fc1e9bf6e9ca5a1228e184c44286797ea39580fdb3e53e1507ab00871"} Sep 08 08:49:04.300582 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:04.300525 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:04.390196 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:04.390149 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:04.496899 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:04.496855 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:05.392058 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:05.392015 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:05.493299 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:05.493251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:05.753080 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:05.752980 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-knr98" event={"ID":"13f80f01-4025-4197-9ed4-1fb449913610","Type":"ContainerStarted","Data":"d2d8aa49661362b138683728a1a0e819cb87cbb479e799dd04b70220059794db"} Sep 08 08:49:05.777523 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:05.777466 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-knr98" podStartSLOduration=34.458669425 podStartE2EDuration="36.777446445s" totalImagesPullingTime="2.31877702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 08:48:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:05.776272037 +0000 UTC m=+90.093728254" watchObservedRunningTime="2026-09-08 08:49:05.777446445 +0000 UTC m=+90.094902663" Sep 08 08:49:06.263505 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:06.263473 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:49:07.458684 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:07.458644 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:07.562419 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:07.562375 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:07.715948 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:07.715856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:08.627216 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:08.627179 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:08.749427 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:08.749385 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:10.290224 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.290188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:10.551006 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.550892 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:10.677400 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.677360 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:10.695777 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.695724 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rnt6n"] Sep 08 08:49:10.701979 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.701950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.705344 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.705315 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 08:49:10.705582 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.705321 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 08:49:10.705782 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.705739 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 08:49:10.705907 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.705791 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 08:49:10.706274 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.706255 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ct9mh\"" Sep 08 08:49:10.796399 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-sys\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796399 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-textfile\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2300782b-77a4-44cc-8df5-16f823288572-metrics-client-ca\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-wtmp\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62fxw\" (UniqueName: \"kubernetes.io/projected/2300782b-77a4-44cc-8df5-16f823288572-kube-api-access-62fxw\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796585 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-tls\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.796656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.796605 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-root\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.802160 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.802072 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:10.897422 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-wtmp\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62fxw\" (UniqueName: \"kubernetes.io/projected/2300782b-77a4-44cc-8df5-16f823288572-kube-api-access-62fxw\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-wtmp\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-tls\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-root\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-sys\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-textfile\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2300782b-77a4-44cc-8df5-16f823288572-metrics-client-ca\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897799 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-root\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.897894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.897808 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2300782b-77a4-44cc-8df5-16f823288572-sys\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.898185 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.898162 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-textfile\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.898270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.898245 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-accelerators-collector-config\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.898328 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.898317 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2300782b-77a4-44cc-8df5-16f823288572-metrics-client-ca\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.900037 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.900014 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-tls\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.900156 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.900055 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2300782b-77a4-44cc-8df5-16f823288572-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.920178 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.920139 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fxw\" (UniqueName: \"kubernetes.io/projected/2300782b-77a4-44cc-8df5-16f823288572-kube-api-access-62fxw\") pod \"node-exporter-rnt6n\" (UID: \"2300782b-77a4-44cc-8df5-16f823288572\") " pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:10.936169 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:10.936126 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:11.011672 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.011634 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rnt6n" Sep 08 08:49:11.017630 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.017587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:11.024839 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:11.024803 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2300782b_77a4_44cc_8df5_16f823288572.slice/crio-9aa22f5e2ec3686b8abcd06e69cc1694e69e7656d9ab19c04c4001c57274d386 WatchSource:0}: Error finding container 9aa22f5e2ec3686b8abcd06e69cc1694e69e7656d9ab19c04c4001c57274d386: Status 404 returned error can't find the container with id 9aa22f5e2ec3686b8abcd06e69cc1694e69e7656d9ab19c04c4001c57274d386 Sep 08 08:49:11.593068 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.593025 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:11.690508 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.690463 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:11.775884 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.775845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnt6n" event={"ID":"2300782b-77a4-44cc-8df5-16f823288572","Type":"ContainerStarted","Data":"9aa22f5e2ec3686b8abcd06e69cc1694e69e7656d9ab19c04c4001c57274d386"} Sep 08 08:49:11.806198 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.806097 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:11.905758 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:11.905648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:12.781835 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:12.781790 2561 generic.go:356] "Generic (PLEG): container finished" podID="2300782b-77a4-44cc-8df5-16f823288572" containerID="52da4fd51f9ffd4d3bff99680b09b30e56b3d72e20a2484954addcb8119372ef" exitCode=0 Sep 08 08:49:12.781835 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:12.781845 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnt6n" event={"ID":"2300782b-77a4-44cc-8df5-16f823288572","Type":"ContainerDied","Data":"52da4fd51f9ffd4d3bff99680b09b30e56b3d72e20a2484954addcb8119372ef"} Sep 08 08:49:13.509171 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.509135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:13.608796 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.608711 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:13.670628 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.670579 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69d767f884-7d7z4"] Sep 08 08:49:13.674919 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.674891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.681386 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.681359 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 08 08:49:13.681632 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.681614 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 08 08:49:13.682800 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.682775 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-gmbd1dfq17s\"" Sep 08 08:49:13.684476 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.684453 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 08 08:49:13.684605 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.684455 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 08 08:49:13.684699 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.684682 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 08 08:49:13.684810 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.684792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hztgh\"" Sep 08 08:49:13.707103 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.707068 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d767f884-7d7z4"] Sep 08 08:49:13.764281 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.764177 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:13.788238 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.788199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnt6n" event={"ID":"2300782b-77a4-44cc-8df5-16f823288572","Type":"ContainerStarted","Data":"ffead0e7f29eb6315b08cc9377db1b7cfd439a7a1a2318e56b700275a8be5f20"} Sep 08 08:49:13.788620 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.788269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rnt6n" event={"ID":"2300782b-77a4-44cc-8df5-16f823288572","Type":"ContainerStarted","Data":"6c1c5edfa9c3dd760211269b7dc87d5bbe71277eef1418710ddde4571dc20795"} Sep 08 08:49:13.815320 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.815248 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rnt6n" podStartSLOduration=2.37722469 podStartE2EDuration="3.815224689s" totalImagesPullingTime="1.371177308s" totalInitContainerRuntime="66.822691ms" isStatefulPod=true podCreationTimestamp="2026-09-08 08:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:13.814346518 +0000 UTC m=+98.131802735" watchObservedRunningTime="2026-09-08 08:49:13.815224689 +0000 UTC m=+98.132680910" Sep 08 08:49:13.825776 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.825707 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.825950 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.825814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-tls\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.825950 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.825864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.826026 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.825948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.826026 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.825968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.826088 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.826027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0282f02b-7b78-4063-af76-6a498a90f1d9-metrics-client-ca\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.826088 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.826057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-grpc-tls\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.826088 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.826077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9zt\" (UniqueName: \"kubernetes.io/projected/0282f02b-7b78-4063-af76-6a498a90f1d9-kube-api-access-cb9zt\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.906725 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.906688 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:13.926806 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.926738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.926911 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.926814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-tls\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.927010 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.926984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.927207 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.927177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.927344 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.927230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.927344 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.927270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0282f02b-7b78-4063-af76-6a498a90f1d9-metrics-client-ca\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.927344 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.927304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-grpc-tls\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.927344 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.927330 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9zt\" (UniqueName: \"kubernetes.io/projected/0282f02b-7b78-4063-af76-6a498a90f1d9-kube-api-access-cb9zt\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.928296 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.928264 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0282f02b-7b78-4063-af76-6a498a90f1d9-metrics-client-ca\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.930099 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.930070 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-tls\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.930240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.930091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.930240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.930127 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.930350 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.930252 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.930350 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.930285 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.930706 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.930688 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0282f02b-7b78-4063-af76-6a498a90f1d9-secret-grpc-tls\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.940415 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.940386 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9zt\" (UniqueName: \"kubernetes.io/projected/0282f02b-7b78-4063-af76-6a498a90f1d9-kube-api-access-cb9zt\") pod \"thanos-querier-69d767f884-7d7z4\" (UID: \"0282f02b-7b78-4063-af76-6a498a90f1d9\") " pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:13.985889 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:13.985845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:14.271229 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:14.271187 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69d767f884-7d7z4"] Sep 08 08:49:14.274529 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:14.274492 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0282f02b_7b78_4063_af76_6a498a90f1d9.slice/crio-8194d4fd342ca246d4c5ac314651ae6c546ee20b48ec350d5ff139cc1c1aa095 WatchSource:0}: Error finding container 8194d4fd342ca246d4c5ac314651ae6c546ee20b48ec350d5ff139cc1c1aa095: Status 404 returned error can't find the container with id 8194d4fd342ca246d4c5ac314651ae6c546ee20b48ec350d5ff139cc1c1aa095 Sep 08 08:49:14.793231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:14.793163 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"8194d4fd342ca246d4c5ac314651ae6c546ee20b48ec350d5ff139cc1c1aa095"} Sep 08 08:49:15.046033 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.045936 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:15.070653 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.070606 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f958f66cf-sjw75"] Sep 08 08:49:15.075025 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.074987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.079059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.078691 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 08 08:49:15.079059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.078730 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 08 08:49:15.079059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.078766 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 08 08:49:15.079059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.078691 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4f0epcpp1aogl\"" Sep 08 08:49:15.079059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.078863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 08 08:49:15.079059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.078706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4zg7p\"" Sep 08 08:49:15.084776 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.084724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f958f66cf-sjw75"] Sep 08 08:49:15.139111 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-secret-metrics-server-tls\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.139305 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588b80-d1aa-403e-94d8-326704a02d6e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.139305 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-secret-metrics-server-client-certs\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.139432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0b588b80-d1aa-403e-94d8-326704a02d6e-audit-log\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.139432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0b588b80-d1aa-403e-94d8-326704a02d6e-metrics-server-audit-profiles\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.139432 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-client-ca-bundle\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.139554 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.139433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwg2\" (UniqueName: \"kubernetes.io/projected/0b588b80-d1aa-403e-94d8-326704a02d6e-kube-api-access-rkwg2\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.146796 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.146689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:15.240516 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240465 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwg2\" (UniqueName: \"kubernetes.io/projected/0b588b80-d1aa-403e-94d8-326704a02d6e-kube-api-access-rkwg2\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.240712 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-secret-metrics-server-tls\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.240712 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588b80-d1aa-403e-94d8-326704a02d6e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.240712 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-secret-metrics-server-client-certs\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.240908 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0b588b80-d1aa-403e-94d8-326704a02d6e-audit-log\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.240908 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0b588b80-d1aa-403e-94d8-326704a02d6e-metrics-server-audit-profiles\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.240908 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.240783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-client-ca-bundle\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.242040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.241588 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588b80-d1aa-403e-94d8-326704a02d6e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.242040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.241961 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0b588b80-d1aa-403e-94d8-326704a02d6e-audit-log\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.242040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.241961 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0b588b80-d1aa-403e-94d8-326704a02d6e-metrics-server-audit-profiles\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.244190 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.244154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-client-ca-bundle\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.244330 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.244270 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-secret-metrics-server-tls\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.244506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.244464 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0b588b80-d1aa-403e-94d8-326704a02d6e-secret-metrics-server-client-certs\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.250401 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.250351 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwg2\" (UniqueName: \"kubernetes.io/projected/0b588b80-d1aa-403e-94d8-326704a02d6e-kube-api-access-rkwg2\") pod \"metrics-server-f958f66cf-sjw75\" (UID: \"0b588b80-d1aa-403e-94d8-326704a02d6e\") " pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.319956 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.319851 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:15.388974 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.388935 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:15.677462 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.677366 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f958f66cf-sjw75"] Sep 08 08:49:15.681360 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:15.681318 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b588b80_d1aa_403e_94d8_326704a02d6e.slice/crio-645a8a1027c42dca607ef53aca749b8c0fd5cc04340f5bcf43a49894877d50da WatchSource:0}: Error finding container 645a8a1027c42dca607ef53aca749b8c0fd5cc04340f5bcf43a49894877d50da: Status 404 returned error can't find the container with id 645a8a1027c42dca607ef53aca749b8c0fd5cc04340f5bcf43a49894877d50da Sep 08 08:49:15.798694 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.798655 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" event={"ID":"0b588b80-d1aa-403e-94d8-326704a02d6e","Type":"ContainerStarted","Data":"645a8a1027c42dca607ef53aca749b8c0fd5cc04340f5bcf43a49894877d50da"} Sep 08 08:49:15.984616 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:15.984519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:16.604665 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:16.604577 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:16.702798 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:16.702757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:16.806188 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:16.806145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"d8efb05f831ae42de07ee2442d99996938027093d17ea68c90217cacafd19cc1"} Sep 08 08:49:16.806641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:16.806258 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"c42e2fcef87194a652b62f71e69ad3e773bf4595d92497a6aa48ec62aca9a9a1"} Sep 08 08:49:16.806641 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:16.806297 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"a7cd24d48f40726d6e54f2df69c150474ef1d3ed0172e6c967bd85d2ceead08f"} Sep 08 08:49:16.904539 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:16.904452 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:17.142562 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:17.142517 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:17.240977 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:17.240865 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:17.812841 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:17.812804 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"6068b1818b3c7ffc6f88adc06245d99b8de4212f14add0f26bdfa288c35db7ba"} Sep 08 08:49:17.814625 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:17.814597 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" event={"ID":"0b588b80-d1aa-403e-94d8-326704a02d6e","Type":"ContainerStarted","Data":"4c18cc2572412244022f5da445b0780464a20f1f15f069f2331df19acc669d74"} Sep 08 08:49:17.834309 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:17.834199 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" podStartSLOduration=1.194819271 podStartE2EDuration="2.834157837s" totalImagesPullingTime="1.639338566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:17.832294124 +0000 UTC m=+102.149750343" watchObservedRunningTime="2026-09-08 08:49:17.834157837 +0000 UTC m=+102.151614060" Sep 08 08:49:18.725895 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:18.725867 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74c598bc86-g59qs" Sep 08 08:49:18.821833 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:18.821791 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"425bd084c60b4e8c37c084ef587eab6ce7da2abe439e9cb21771e266ef475465"} Sep 08 08:49:18.822263 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:18.821874 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" event={"ID":"0282f02b-7b78-4063-af76-6a498a90f1d9","Type":"ContainerStarted","Data":"0b0f2c31cec921afa22671b1a1b0007cd09c106bbb92901f8f9ce879c030a80e"} Sep 08 08:49:18.845798 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:18.845708 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" podStartSLOduration=2.687387735 podStartE2EDuration="5.845685641s" totalImagesPullingTime="3.158297906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:49:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:18.845336195 +0000 UTC m=+103.162792414" watchObservedRunningTime="2026-09-08 08:49:18.845685641 +0000 UTC m=+103.163141859" Sep 08 08:49:18.877565 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:18.877533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:18.982076 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:18.981991 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:19.049624 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:19.049581 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:19.682771 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:19.682713 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cb5sh" Sep 08 08:49:19.825633 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:19.825597 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:21.278449 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.278405 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" podUID="d224a77b-505b-4159-b83f-3d1396f77ec0" containerName="registry" containerID="cri-o://b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f" gracePeriod=30 Sep 08 08:49:21.559923 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.559837 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:49:21.600195 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600158 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w8h8\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-kube-api-access-8w8h8\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600340 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600254 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d224a77b-505b-4159-b83f-3d1396f77ec0-ca-trust-extracted\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600340 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600288 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-trusted-ca\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600340 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600312 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-image-registry-private-configuration\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600486 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600341 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-bound-sa-token\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600486 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600380 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-certificates\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600486 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600441 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600486 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600472 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-installation-pull-secrets\") pod \"d224a77b-505b-4159-b83f-3d1396f77ec0\" (UID: \"d224a77b-505b-4159-b83f-3d1396f77ec0\") " Sep 08 08:49:21.600821 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.600730 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:49:21.601777 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.601111 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:49:21.603590 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.603541 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-kube-api-access-8w8h8" (OuterVolumeSpecName: "kube-api-access-8w8h8") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "kube-api-access-8w8h8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:49:21.603703 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.603661 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:49:21.603703 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.603675 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:49:21.603839 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.603770 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:49:21.603888 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.603832 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:49:21.610135 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.610086 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d224a77b-505b-4159-b83f-3d1396f77ec0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d224a77b-505b-4159-b83f-3d1396f77ec0" (UID: "d224a77b-505b-4159-b83f-3d1396f77ec0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:49:21.702022 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.701984 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-installation-pull-secrets\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702022 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702014 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w8h8\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-kube-api-access-8w8h8\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702022 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702024 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d224a77b-505b-4159-b83f-3d1396f77ec0-ca-trust-extracted\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702022 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702033 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-trusted-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702042 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d224a77b-505b-4159-b83f-3d1396f77ec0-image-registry-private-configuration\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702052 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-bound-sa-token\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702061 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-certificates\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.702270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.702069 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d224a77b-505b-4159-b83f-3d1396f77ec0-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:49:21.831617 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.831533 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-thgbb"] Sep 08 08:49:21.831856 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.831842 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d224a77b-505b-4159-b83f-3d1396f77ec0" containerName="registry" Sep 08 08:49:21.831944 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.831857 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d224a77b-505b-4159-b83f-3d1396f77ec0" containerName="registry" Sep 08 08:49:21.831944 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.831913 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d224a77b-505b-4159-b83f-3d1396f77ec0" containerName="registry" Sep 08 08:49:21.834274 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.834247 2561 generic.go:356] "Generic (PLEG): container finished" podID="d224a77b-505b-4159-b83f-3d1396f77ec0" containerID="b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f" exitCode=0 Sep 08 08:49:21.834398 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.834365 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" Sep 08 08:49:21.847038 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.847006 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:21.874944 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.874907 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" event={"ID":"d224a77b-505b-4159-b83f-3d1396f77ec0","Type":"ContainerDied","Data":"b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f"} Sep 08 08:49:21.874944 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.874945 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59967cd7b-q9fmz" event={"ID":"d224a77b-505b-4159-b83f-3d1396f77ec0","Type":"ContainerDied","Data":"502d26ded840701c2f1916778a083c429564d059d3a1340324719670fc18bf2b"} Sep 08 08:49:21.875158 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.874962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-thgbb"] Sep 08 08:49:21.875158 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.874982 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59967cd7b-q9fmz"] Sep 08 08:49:21.875158 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.874994 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59967cd7b-q9fmz"] Sep 08 08:49:21.875158 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.875030 2561 scope.go:117] "RemoveContainer" containerID="b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f" Sep 08 08:49:21.875158 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.875035 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:21.877240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.877223 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zvpds\"" Sep 08 08:49:21.877679 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.877664 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 08 08:49:21.877763 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.877694 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 08 08:49:21.885180 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.885161 2561 scope.go:117] "RemoveContainer" containerID="b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f" Sep 08 08:49:21.885532 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:49:21.885510 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f\": container with ID starting with b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f not found: ID does not exist" containerID="b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f" Sep 08 08:49:21.885590 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.885540 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f"} err="failed to get container status \"b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f\": rpc error: code = NotFound desc = could not find container \"b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f\": container with ID starting with b91777d85c736943463b5d9c08e648a0dcd1a81aad44be1b208de6ab5de14f6f not found: ID does not exist" Sep 08 08:49:21.904016 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.903979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccbpp\" (UniqueName: \"kubernetes.io/projected/6cfdf44e-9527-4da5-916c-d946a9684824-kube-api-access-ccbpp\") pod \"downloads-85d98c998f-thgbb\" (UID: \"6cfdf44e-9527-4da5-916c-d946a9684824\") " pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:21.944871 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:21.944838 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:22.001563 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.001532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:22.004553 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.004527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccbpp\" (UniqueName: \"kubernetes.io/projected/6cfdf44e-9527-4da5-916c-d946a9684824-kube-api-access-ccbpp\") pod \"downloads-85d98c998f-thgbb\" (UID: \"6cfdf44e-9527-4da5-916c-d946a9684824\") " pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:22.014122 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.014087 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccbpp\" (UniqueName: \"kubernetes.io/projected/6cfdf44e-9527-4da5-916c-d946a9684824-kube-api-access-ccbpp\") pod \"downloads-85d98c998f-thgbb\" (UID: \"6cfdf44e-9527-4da5-916c-d946a9684824\") " pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:22.171214 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.171108 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:22.184994 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.184960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:22.212695 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.212649 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d224a77b-505b-4159-b83f-3d1396f77ec0" path="/var/lib/kubelet/pods/d224a77b-505b-4159-b83f-3d1396f77ec0/volumes" Sep 08 08:49:22.289828 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.289783 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:22.350766 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.350689 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:22.484780 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.484659 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-thgbb"] Sep 08 08:49:22.487791 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:22.487758 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfdf44e_9527_4da5_916c_d946a9684824.slice/crio-47c5b3de5da316b1e22b3e21611c7c603193a531ab0afc1c305c597f066a4c92 WatchSource:0}: Error finding container 47c5b3de5da316b1e22b3e21611c7c603193a531ab0afc1c305c597f066a4c92: Status 404 returned error can't find the container with id 47c5b3de5da316b1e22b3e21611c7c603193a531ab0afc1c305c597f066a4c92 Sep 08 08:49:22.840071 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:22.840022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-thgbb" event={"ID":"6cfdf44e-9527-4da5-916c-d946a9684824","Type":"ContainerStarted","Data":"47c5b3de5da316b1e22b3e21611c7c603193a531ab0afc1c305c597f066a4c92"} Sep 08 08:49:23.135048 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:23.131264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:24.308562 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:24.308511 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:24.410871 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:24.410828 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:24.561913 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:24.561822 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:25.837280 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:25.837239 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69d767f884-7d7z4" Sep 08 08:49:25.932874 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:25.932822 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:29.121109 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:29.121068 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:29.182974 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:29.182935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:30.028533 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.028469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:30.128710 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.128668 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:30.766116 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.766070 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f577c4b66-5glbt"] Sep 08 08:49:30.772948 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.772912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.776933 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.776871 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 08 08:49:30.777138 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.776937 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 08 08:49:30.777138 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.776896 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 08 08:49:30.777138 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.776893 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 08 08:49:30.777138 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.776940 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xxztb\"" Sep 08 08:49:30.777138 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.776893 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 08 08:49:30.780682 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.780646 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f577c4b66-5glbt"] Sep 08 08:49:30.887960 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.887911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-serving-cert\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.888240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.887996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-oauth-serving-cert\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.888240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.888044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsq56\" (UniqueName: \"kubernetes.io/projected/4c04f955-56bc-4da5-98ab-a318f83982e9-kube-api-access-qsq56\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.888240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.888074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-service-ca\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.888240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.888108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-oauth-config\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.888240 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.888144 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-console-config\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.989506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.989449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-serving-cert\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.989680 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.989534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-oauth-serving-cert\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.989680 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.989598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsq56\" (UniqueName: \"kubernetes.io/projected/4c04f955-56bc-4da5-98ab-a318f83982e9-kube-api-access-qsq56\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.989680 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.989641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-service-ca\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.989680 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.989671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-oauth-config\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.989937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.989690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-console-config\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.990492 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.990466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-oauth-serving-cert\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.990572 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.990466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-console-config\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.990619 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.990586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-service-ca\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.992529 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.992496 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-serving-cert\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.992670 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.992578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-oauth-config\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:30.999511 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:30.999467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsq56\" (UniqueName: \"kubernetes.io/projected/4c04f955-56bc-4da5-98ab-a318f83982e9-kube-api-access-qsq56\") pod \"console-6f577c4b66-5glbt\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:31.086990 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:31.086882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:31.377567 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:31.377509 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f577c4b66-5glbt"] Sep 08 08:49:31.380841 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:31.380800 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c04f955_56bc_4da5_98ab_a318f83982e9.slice/crio-c1bb00bfd28ec15fc202794db28e5f2ff2bcc15ac8335cf6e710832827367a3f WatchSource:0}: Error finding container c1bb00bfd28ec15fc202794db28e5f2ff2bcc15ac8335cf6e710832827367a3f: Status 404 returned error can't find the container with id c1bb00bfd28ec15fc202794db28e5f2ff2bcc15ac8335cf6e710832827367a3f Sep 08 08:49:31.886136 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:31.886091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f577c4b66-5glbt" event={"ID":"4c04f955-56bc-4da5-98ab-a318f83982e9","Type":"ContainerStarted","Data":"c1bb00bfd28ec15fc202794db28e5f2ff2bcc15ac8335cf6e710832827367a3f"} Sep 08 08:49:35.389697 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:35.389653 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:35.390197 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:35.389765 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:35.752893 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:35.752711 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:35.854940 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:35.854887 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:36.765317 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:36.765259 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:36.856465 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:36.856418 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:38.157640 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.157579 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd496fd8f-27jmn"] Sep 08 08:49:38.164579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.164545 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.174537 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.174500 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 08 08:49:38.179053 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.179008 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:38.188970 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.188932 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd496fd8f-27jmn"] Sep 08 08:49:38.265655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-service-ca\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.265655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-config\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.265930 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265674 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rdtr\" (UniqueName: \"kubernetes.io/projected/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-kube-api-access-8rdtr\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.265930 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265759 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-oauth-serving-cert\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.265930 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-serving-cert\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.265930 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-oauth-config\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.266071 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.265956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-trusted-ca-bundle\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.281457 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.281418 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:38.366685 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-trusted-ca-bundle\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.366902 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366708 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-service-ca\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.366902 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-config\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.366902 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rdtr\" (UniqueName: \"kubernetes.io/projected/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-kube-api-access-8rdtr\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.366902 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-oauth-serving-cert\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.366902 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366899 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-serving-cert\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.367168 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.366947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-oauth-config\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.367580 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.367526 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-service-ca\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.367706 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.367639 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-config\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.367706 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.367639 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-trusted-ca-bundle\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.367829 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.367806 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-oauth-serving-cert\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.370473 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.370440 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-oauth-config\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.370613 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.370493 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-serving-cert\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.377149 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.377107 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rdtr\" (UniqueName: \"kubernetes.io/projected/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-kube-api-access-8rdtr\") pod \"console-7bd496fd8f-27jmn\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.479258 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.479153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:38.917951 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.917910 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ef35c96-52a6-4a20-a073-503a365cfe7e" containerID="954313dfd6eda9565b998fb4e1b1a42088be7e3748b303cc151f049747cb977c" exitCode=0 Sep 08 08:49:38.918135 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.917997 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" event={"ID":"4ef35c96-52a6-4a20-a073-503a365cfe7e","Type":"ContainerDied","Data":"954313dfd6eda9565b998fb4e1b1a42088be7e3748b303cc151f049747cb977c"} Sep 08 08:49:38.918474 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.918438 2561 scope.go:117] "RemoveContainer" containerID="954313dfd6eda9565b998fb4e1b1a42088be7e3748b303cc151f049747cb977c" Sep 08 08:49:38.921595 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.921562 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-thgbb" event={"ID":"6cfdf44e-9527-4da5-916c-d946a9684824","Type":"ContainerStarted","Data":"4683ba6cb7ef07e4a38bf98eba26bdb1b2d71c92f3e77ae143bbe983e0cd1367"} Sep 08 08:49:38.921995 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.921972 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:38.923910 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.923872 2561 patch_prober.go:28] interesting pod/downloads-85d98c998f-thgbb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.19:8080/\": dial tcp 10.133.0.19:8080: connect: connection refused" start-of-body= Sep 08 08:49:38.924074 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.923941 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-thgbb" podUID="6cfdf44e-9527-4da5-916c-d946a9684824" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.19:8080/\": dial tcp 10.133.0.19:8080: connect: connection refused" Sep 08 08:49:38.954516 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.954307 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-thgbb" podStartSLOduration=1.6377419789999998 podStartE2EDuration="17.95427666s" totalImagesPullingTime="16.316534681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:38.952709259 +0000 UTC m=+123.270165497" watchObservedRunningTime="2026-09-08 08:49:38.95427666 +0000 UTC m=+123.271732881" Sep 08 08:49:38.979393 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:38.979343 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd496fd8f-27jmn"] Sep 08 08:49:38.986143 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:38.986104 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd6fed7_401d_40b9_8eaa_0d457dc0c603.slice/crio-761737d0d22fd307cd2a2eef4242cff9571afbfa6bd7dc7e29d9e3f785dba319 WatchSource:0}: Error finding container 761737d0d22fd307cd2a2eef4242cff9571afbfa6bd7dc7e29d9e3f785dba319: Status 404 returned error can't find the container with id 761737d0d22fd307cd2a2eef4242cff9571afbfa6bd7dc7e29d9e3f785dba319 Sep 08 08:49:39.938347 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:39.938242 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd496fd8f-27jmn" event={"ID":"6bd6fed7-401d-40b9-8eaa-0d457dc0c603","Type":"ContainerStarted","Data":"761737d0d22fd307cd2a2eef4242cff9571afbfa6bd7dc7e29d9e3f785dba319"} Sep 08 08:49:39.945220 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:39.944328 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-b5rbh" event={"ID":"4ef35c96-52a6-4a20-a073-503a365cfe7e","Type":"ContainerStarted","Data":"ea465305982e89a8eb8f2fd0aa465e4f4f381bd68af53eb4d8fbe19c0d409e87"} Sep 08 08:49:39.956770 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:39.956712 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-thgbb" Sep 08 08:49:41.339682 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:41.339602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:42.245661 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:42.245561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-kw4dt_85d7825f-122f-47cf-a34c-184882f47edf/cluster-monitoring-operator/0.log" Sep 08 08:49:43.041147 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:43.041111 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f958f66cf-sjw75_0b588b80-d1aa-403e-94d8-326704a02d6e/metrics-server/0.log" Sep 08 08:49:43.967263 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:43.967216 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f577c4b66-5glbt" event={"ID":"4c04f955-56bc-4da5-98ab-a318f83982e9","Type":"ContainerStarted","Data":"09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea"} Sep 08 08:49:43.969311 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:43.969274 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd496fd8f-27jmn" event={"ID":"6bd6fed7-401d-40b9-8eaa-0d457dc0c603","Type":"ContainerStarted","Data":"d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07"} Sep 08 08:49:43.984966 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:43.984903 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f577c4b66-5glbt" podStartSLOduration=2.240944721 podStartE2EDuration="13.984877605s" totalImagesPullingTime="11.743932884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:43.984504157 +0000 UTC m=+128.301960375" watchObservedRunningTime="2026-09-08 08:49:43.984877605 +0000 UTC m=+128.302333824" Sep 08 08:49:44.001178 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:44.001112 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd496fd8f-27jmn" podStartSLOduration=1.853668956 podStartE2EDuration="6.001082083s" totalImagesPullingTime="4.147413127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:49:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:43.999839345 +0000 UTC m=+128.317295563" watchObservedRunningTime="2026-09-08 08:49:44.001082083 +0000 UTC m=+128.318538302" Sep 08 08:49:44.640678 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:44.640643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnt6n_2300782b-77a4-44cc-8df5-16f823288572/init-textfile/0.log" Sep 08 08:49:44.842691 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:44.842597 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnt6n_2300782b-77a4-44cc-8df5-16f823288572/node-exporter/0.log" Sep 08 08:49:45.020476 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:45.020425 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:45.041646 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:45.041611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnt6n_2300782b-77a4-44cc-8df5-16f823288572/kube-rbac-proxy/0.log" Sep 08 08:49:45.082065 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:45.082029 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:45.952671 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:45.952611 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:49:45.955565 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:45.955519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/030a7a26-d668-4f3f-8078-b7ed24dab6fc-metrics-certs\") pod \"network-metrics-daemon-krcc8\" (UID: \"030a7a26-d668-4f3f-8078-b7ed24dab6fc\") " pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:49:46.132382 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:46.132343 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dt6vp\"" Sep 08 08:49:46.140398 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:46.140347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krcc8" Sep 08 08:49:46.456603 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:46.456422 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-krcc8"] Sep 08 08:49:46.459542 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:49:46.459501 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030a7a26_d668_4f3f_8078_b7ed24dab6fc.slice/crio-b42f94bb2b57ff338c93936ea51408362069d5ddb49b6be2ef04c2b4c31456a0 WatchSource:0}: Error finding container b42f94bb2b57ff338c93936ea51408362069d5ddb49b6be2ef04c2b4c31456a0: Status 404 returned error can't find the container with id b42f94bb2b57ff338c93936ea51408362069d5ddb49b6be2ef04c2b4c31456a0 Sep 08 08:49:46.986580 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:46.986534 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krcc8" event={"ID":"030a7a26-d668-4f3f-8078-b7ed24dab6fc","Type":"ContainerStarted","Data":"b42f94bb2b57ff338c93936ea51408362069d5ddb49b6be2ef04c2b4c31456a0"} Sep 08 08:49:47.841040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:47.841008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/thanos-query/0.log" Sep 08 08:49:47.854475 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:47.854424 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:48.041365 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.041327 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy-web/0.log" Sep 08 08:49:48.241142 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.241106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy/0.log" Sep 08 08:49:48.441384 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.441352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/prom-label-proxy/0.log" Sep 08 08:49:48.479284 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.479242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:48.479469 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.479299 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:48.484643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.484612 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:48.641506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.641417 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy-rules/0.log" Sep 08 08:49:48.824948 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.824903 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:48.840052 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.840020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy-metrics/0.log" Sep 08 08:49:48.997486 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.997383 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krcc8" event={"ID":"030a7a26-d668-4f3f-8078-b7ed24dab6fc","Type":"ContainerStarted","Data":"fc32552d73307f1afb021a8a85af28b5077fb846abdaf53c38d7709ab8c2ca7b"} Sep 08 08:49:48.997486 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:48.997448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krcc8" event={"ID":"030a7a26-d668-4f3f-8078-b7ed24dab6fc","Type":"ContainerStarted","Data":"b911f8dc68d4e5ba1803f2b1342a598c601854b50dd2717bc82bf6cb3d84ba1d"} Sep 08 08:49:49.001350 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.001324 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:49:49.013501 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.013435 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-krcc8" podStartSLOduration=131.364595668 podStartE2EDuration="2m13.013416034s" totalImagesPullingTime="1.648820366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:49:49.011903439 +0000 UTC m=+133.329359657" watchObservedRunningTime="2026-09-08 08:49:49.013416034 +0000 UTC m=+133.330872252" Sep 08 08:49:49.060402 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.060358 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f577c4b66-5glbt"] Sep 08 08:49:49.165409 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.165368 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:49.263198 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.263160 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:49.364044 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.364006 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:49.436833 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.436789 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:49.642039 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.641943 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f577c4b66-5glbt_4c04f955-56bc-4da5-98ab-a318f83982e9/console/0.log" Sep 08 08:49:49.840936 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.840902 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd496fd8f-27jmn_6bd6fed7-401d-40b9-8eaa-0d457dc0c603/console/0.log" Sep 08 08:49:49.940903 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:49.940806 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:50.043411 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:50.043376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-thgbb_6cfdf44e-9527-4da5-916c-d946a9684824/download-server/0.log" Sep 08 08:49:50.241224 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:50.241128 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c55f786f4-nxzlc_cf2212f1-f58b-4af1-a6d6-0136f525940e/router/0.log" Sep 08 08:49:50.841710 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:50.841669 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxt2r_fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4/serve-healthcheck-canary/0.log" Sep 08 08:49:51.087271 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:51.087230 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:49:53.873066 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:53.873019 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:53.974906 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:53.974806 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:54.072954 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:54.072801 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:55.400181 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:55.400136 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:55.404495 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:55.404466 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f958f66cf-sjw75" Sep 08 08:49:56.106904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:56.106863 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:49:56.203769 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:49:56.203695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:14.082221 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.082146 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f577c4b66-5glbt" podUID="4c04f955-56bc-4da5-98ab-a318f83982e9" containerName="console" containerID="cri-o://09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea" gracePeriod=15 Sep 08 08:50:14.366848 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.366737 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:50:14.517908 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.517869 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsq56\" (UniqueName: \"kubernetes.io/projected/4c04f955-56bc-4da5-98ab-a318f83982e9-kube-api-access-qsq56\") pod \"4c04f955-56bc-4da5-98ab-a318f83982e9\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " Sep 08 08:50:14.518108 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.517951 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-oauth-config\") pod \"4c04f955-56bc-4da5-98ab-a318f83982e9\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " Sep 08 08:50:14.518108 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.517974 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-serving-cert\") pod \"4c04f955-56bc-4da5-98ab-a318f83982e9\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " Sep 08 08:50:14.518108 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.518078 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-oauth-serving-cert\") pod \"4c04f955-56bc-4da5-98ab-a318f83982e9\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " Sep 08 08:50:14.518271 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.518176 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-service-ca\") pod \"4c04f955-56bc-4da5-98ab-a318f83982e9\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " Sep 08 08:50:14.518271 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.518210 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-console-config\") pod \"4c04f955-56bc-4da5-98ab-a318f83982e9\" (UID: \"4c04f955-56bc-4da5-98ab-a318f83982e9\") " Sep 08 08:50:14.518526 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.518492 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c04f955-56bc-4da5-98ab-a318f83982e9" (UID: "4c04f955-56bc-4da5-98ab-a318f83982e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:50:14.518603 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.518559 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c04f955-56bc-4da5-98ab-a318f83982e9" (UID: "4c04f955-56bc-4da5-98ab-a318f83982e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:50:14.518660 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.518631 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-console-config" (OuterVolumeSpecName: "console-config") pod "4c04f955-56bc-4da5-98ab-a318f83982e9" (UID: "4c04f955-56bc-4da5-98ab-a318f83982e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:50:14.520411 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.520374 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c04f955-56bc-4da5-98ab-a318f83982e9-kube-api-access-qsq56" (OuterVolumeSpecName: "kube-api-access-qsq56") pod "4c04f955-56bc-4da5-98ab-a318f83982e9" (UID: "4c04f955-56bc-4da5-98ab-a318f83982e9"). InnerVolumeSpecName "kube-api-access-qsq56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:50:14.520411 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.520394 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c04f955-56bc-4da5-98ab-a318f83982e9" (UID: "4c04f955-56bc-4da5-98ab-a318f83982e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:50:14.520570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.520419 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c04f955-56bc-4da5-98ab-a318f83982e9" (UID: "4c04f955-56bc-4da5-98ab-a318f83982e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:50:14.620117 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.619967 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsq56\" (UniqueName: \"kubernetes.io/projected/4c04f955-56bc-4da5-98ab-a318f83982e9-kube-api-access-qsq56\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:50:14.620117 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.620004 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:50:14.620117 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.620018 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c04f955-56bc-4da5-98ab-a318f83982e9-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:50:14.620117 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.620030 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:50:14.620117 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.620045 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:50:14.620117 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:14.620056 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c04f955-56bc-4da5-98ab-a318f83982e9-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:50:15.036652 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.036612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:15.100062 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.100020 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:15.113500 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.113466 2561 generic.go:356] "Generic (PLEG): container finished" podID="4c04f955-56bc-4da5-98ab-a318f83982e9" containerID="09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea" exitCode=0 Sep 08 08:50:15.113687 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.113520 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f577c4b66-5glbt" Sep 08 08:50:15.113687 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.113555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f577c4b66-5glbt" event={"ID":"4c04f955-56bc-4da5-98ab-a318f83982e9","Type":"ContainerDied","Data":"09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea"} Sep 08 08:50:15.113687 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.113618 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f577c4b66-5glbt" event={"ID":"4c04f955-56bc-4da5-98ab-a318f83982e9","Type":"ContainerDied","Data":"c1bb00bfd28ec15fc202794db28e5f2ff2bcc15ac8335cf6e710832827367a3f"} Sep 08 08:50:15.113687 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.113646 2561 scope.go:117] "RemoveContainer" containerID="09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea" Sep 08 08:50:15.123321 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.123300 2561 scope.go:117] "RemoveContainer" containerID="09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea" Sep 08 08:50:15.123706 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:50:15.123687 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea\": container with ID starting with 09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea not found: ID does not exist" containerID="09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea" Sep 08 08:50:15.123780 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.123718 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea"} err="failed to get container status \"09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea\": rpc error: code = NotFound desc = could not find container \"09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea\": container with ID starting with 09a5c1e59d16bdb0c61fa3d6508d145351f10448bbba0bc30a930ac0281357ea not found: ID does not exist" Sep 08 08:50:15.135019 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.134974 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f577c4b66-5glbt"] Sep 08 08:50:15.138969 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:15.138931 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f577c4b66-5glbt"] Sep 08 08:50:16.213318 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:16.213280 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c04f955-56bc-4da5-98ab-a318f83982e9" path="/var/lib/kubelet/pods/4c04f955-56bc-4da5-98ab-a318f83982e9/volumes" Sep 08 08:50:29.916481 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:29.916380 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:30.003674 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:30.003637 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:38.091025 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.090986 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b65d8ffc7-thwts"] Sep 08 08:50:38.091418 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.091281 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c04f955-56bc-4da5-98ab-a318f83982e9" containerName="console" Sep 08 08:50:38.091418 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.091293 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c04f955-56bc-4da5-98ab-a318f83982e9" containerName="console" Sep 08 08:50:38.091418 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.091364 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c04f955-56bc-4da5-98ab-a318f83982e9" containerName="console" Sep 08 08:50:38.094575 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.094550 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.106686 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.106655 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b65d8ffc7-thwts"] Sep 08 08:50:38.114631 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-service-ca\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.114631 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-trusted-ca-bundle\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.114886 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-oauth-config\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.114886 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-console-config\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.114886 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rk5\" (UniqueName: \"kubernetes.io/projected/f308d12d-134b-438d-8b42-e6518e8ec922-kube-api-access-x2rk5\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.114886 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-oauth-serving-cert\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.114886 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.114853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-serving-cert\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.163164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.163124 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:38.215636 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-oauth-config\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.215636 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-console-config\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.215911 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rk5\" (UniqueName: \"kubernetes.io/projected/f308d12d-134b-438d-8b42-e6518e8ec922-kube-api-access-x2rk5\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.215911 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-oauth-serving-cert\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.215911 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-serving-cert\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.215911 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-service-ca\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.215911 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.215815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-trusted-ca-bundle\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.216569 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.216542 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-oauth-serving-cert\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.216653 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.216590 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-console-config\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.216694 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.216659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-service-ca\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.216803 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.216783 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-trusted-ca-bundle\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.218193 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.218171 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-oauth-config\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.218302 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.218273 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-serving-cert\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.223657 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.223632 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rk5\" (UniqueName: \"kubernetes.io/projected/f308d12d-134b-438d-8b42-e6518e8ec922-kube-api-access-x2rk5\") pod \"console-7b65d8ffc7-thwts\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.405929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.405836 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:38.682776 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:38.682707 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b65d8ffc7-thwts"] Sep 08 08:50:38.685543 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:50:38.685511 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf308d12d_134b_438d_8b42_e6518e8ec922.slice/crio-888d37c8f1b5744af5fd3815f9a3c74e7adf9c0f7668ad9437b6e2084ea22af5 WatchSource:0}: Error finding container 888d37c8f1b5744af5fd3815f9a3c74e7adf9c0f7668ad9437b6e2084ea22af5: Status 404 returned error can't find the container with id 888d37c8f1b5744af5fd3815f9a3c74e7adf9c0f7668ad9437b6e2084ea22af5 Sep 08 08:50:39.213059 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:39.213020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65d8ffc7-thwts" event={"ID":"f308d12d-134b-438d-8b42-e6518e8ec922","Type":"ContainerStarted","Data":"052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799"} Sep 08 08:50:39.213514 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:39.213099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65d8ffc7-thwts" event={"ID":"f308d12d-134b-438d-8b42-e6518e8ec922","Type":"ContainerStarted","Data":"888d37c8f1b5744af5fd3815f9a3c74e7adf9c0f7668ad9437b6e2084ea22af5"} Sep 08 08:50:39.231667 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:39.231592 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b65d8ffc7-thwts" podStartSLOduration=1.231570477 podStartE2EDuration="1.231570477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:50:39.230073329 +0000 UTC m=+183.547529549" watchObservedRunningTime="2026-09-08 08:50:39.231570477 +0000 UTC m=+183.549026695" Sep 08 08:50:48.406440 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:48.406391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:48.406927 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:48.406470 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:48.411710 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:48.411655 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:49.255719 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:49.255688 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:50:49.302428 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:49.302374 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd496fd8f-27jmn"] Sep 08 08:50:49.406647 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:49.406604 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:49.467688 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:49.467648 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:50:49.525840 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:50:49.525717 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:10.032903 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:10.032856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:10.135307 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:10.135273 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:14.328987 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.328916 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bd496fd8f-27jmn" podUID="6bd6fed7-401d-40b9-8eaa-0d457dc0c603" containerName="console" containerID="cri-o://d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07" gracePeriod=15 Sep 08 08:51:14.572656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.572628 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:51:14.752279 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752190 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-oauth-serving-cert\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752279 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752225 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-trusted-ca-bundle\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752279 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752284 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rdtr\" (UniqueName: \"kubernetes.io/projected/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-kube-api-access-8rdtr\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752544 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752310 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-oauth-config\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752544 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752328 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-config\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752544 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752343 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-serving-cert\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752544 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752400 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-service-ca\") pod \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\" (UID: \"6bd6fed7-401d-40b9-8eaa-0d457dc0c603\") " Sep 08 08:51:14.752800 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752771 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:51:14.752937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752641 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:51:14.752937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752834 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-config" (OuterVolumeSpecName: "console-config") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:51:14.752937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.752863 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-service-ca" (OuterVolumeSpecName: "service-ca") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:51:14.754713 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.754677 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:51:14.754843 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.754710 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:51:14.754843 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.754808 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-kube-api-access-8rdtr" (OuterVolumeSpecName: "kube-api-access-8rdtr") pod "6bd6fed7-401d-40b9-8eaa-0d457dc0c603" (UID: "6bd6fed7-401d-40b9-8eaa-0d457dc0c603"). InnerVolumeSpecName "kube-api-access-8rdtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:51:14.853164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853116 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:14.853164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853149 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:14.853164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853159 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:14.853164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853169 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rdtr\" (UniqueName: \"kubernetes.io/projected/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-kube-api-access-8rdtr\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:14.853164 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853179 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:14.853452 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853187 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:14.853452 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:14.853195 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd6fed7-401d-40b9-8eaa-0d457dc0c603-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:51:15.355207 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.355163 2561 generic.go:356] "Generic (PLEG): container finished" podID="6bd6fed7-401d-40b9-8eaa-0d457dc0c603" containerID="d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07" exitCode=0 Sep 08 08:51:15.355655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.355214 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd496fd8f-27jmn" Sep 08 08:51:15.355655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.355253 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd496fd8f-27jmn" event={"ID":"6bd6fed7-401d-40b9-8eaa-0d457dc0c603","Type":"ContainerDied","Data":"d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07"} Sep 08 08:51:15.355655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.355310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd496fd8f-27jmn" event={"ID":"6bd6fed7-401d-40b9-8eaa-0d457dc0c603","Type":"ContainerDied","Data":"761737d0d22fd307cd2a2eef4242cff9571afbfa6bd7dc7e29d9e3f785dba319"} Sep 08 08:51:15.355655 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.355334 2561 scope.go:117] "RemoveContainer" containerID="d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07" Sep 08 08:51:15.364231 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.364206 2561 scope.go:117] "RemoveContainer" containerID="d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07" Sep 08 08:51:15.364591 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:51:15.364568 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07\": container with ID starting with d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07 not found: ID does not exist" containerID="d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07" Sep 08 08:51:15.364643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.364600 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07"} err="failed to get container status \"d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07\": rpc error: code = NotFound desc = could not find container \"d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07\": container with ID starting with d0f682f79cb76b955c859258fa7f025090a713739df9354b613d3907d6819f07 not found: ID does not exist" Sep 08 08:51:15.387695 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.387658 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd496fd8f-27jmn"] Sep 08 08:51:15.402684 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:15.402645 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd496fd8f-27jmn"] Sep 08 08:51:16.212760 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:16.212719 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bd6fed7-401d-40b9-8eaa-0d457dc0c603" path="/var/lib/kubelet/pods/6bd6fed7-401d-40b9-8eaa-0d457dc0c603/volumes" Sep 08 08:51:26.911629 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:26.911587 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:45.124238 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:45.124197 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:45.177725 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:45.177678 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:51.795730 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.795690 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786b55bdf9-7hbpz"] Sep 08 08:51:51.796230 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.796182 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bd6fed7-401d-40b9-8eaa-0d457dc0c603" containerName="console" Sep 08 08:51:51.796230 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.796202 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bd6fed7-401d-40b9-8eaa-0d457dc0c603" containerName="console" Sep 08 08:51:51.796345 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.796274 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bd6fed7-401d-40b9-8eaa-0d457dc0c603" containerName="console" Sep 08 08:51:51.800550 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.800525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.811704 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.811666 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786b55bdf9-7hbpz"] Sep 08 08:51:51.850129 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-oauth-serving-cert\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.850302 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-serving-cert\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.850302 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-service-ca\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.850394 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-oauth-config\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.850434 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-config\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.850511 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7956\" (UniqueName: \"kubernetes.io/projected/b57ffc52-b0b6-46a7-86a8-bdedea06d979-kube-api-access-h7956\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.850564 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.850526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-trusted-ca-bundle\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.852596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.852559 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:51.951568 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-oauth-serving-cert\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.951568 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-serving-cert\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.951850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-service-ca\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.951850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-oauth-config\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.951850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-config\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.951850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7956\" (UniqueName: \"kubernetes.io/projected/b57ffc52-b0b6-46a7-86a8-bdedea06d979-kube-api-access-h7956\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.951850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.951700 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-trusted-ca-bundle\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.952620 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.952595 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-service-ca\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.952779 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.952608 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-config\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.952779 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.952615 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-trusted-ca-bundle\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.952779 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.952599 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-oauth-serving-cert\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.953116 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.953090 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:51.954725 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.954695 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-serving-cert\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.954725 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.954716 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-oauth-config\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:51.961729 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:51.961687 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7956\" (UniqueName: \"kubernetes.io/projected/b57ffc52-b0b6-46a7-86a8-bdedea06d979-kube-api-access-h7956\") pod \"console-786b55bdf9-7hbpz\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:52.055417 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.055326 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:52.109705 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.109643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:51:52.386651 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.386563 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786b55bdf9-7hbpz"] Sep 08 08:51:52.505218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.505181 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b55bdf9-7hbpz" event={"ID":"b57ffc52-b0b6-46a7-86a8-bdedea06d979","Type":"ContainerStarted","Data":"00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d"} Sep 08 08:51:52.505421 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.505231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b55bdf9-7hbpz" event={"ID":"b57ffc52-b0b6-46a7-86a8-bdedea06d979","Type":"ContainerStarted","Data":"9c35cc277939eef201025bd634ae46c5f183f738e3b2f2ebb05c2306c4c102a1"} Sep 08 08:51:52.523234 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.523172 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786b55bdf9-7hbpz" podStartSLOduration=1.523153116 podStartE2EDuration="1.523153116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:51:52.521420455 +0000 UTC m=+256.838876678" watchObservedRunningTime="2026-09-08 08:51:52.523153116 +0000 UTC m=+256.840609400" Sep 08 08:51:52.618056 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.618015 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:52.669731 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:52.669536 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:55.731971 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:55.731922 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:57.013413 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:57.013373 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:57.065816 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:57.065773 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:51:57.268014 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:51:57.267908 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:52:00.197781 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:00.197736 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:52:00.363119 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:00.363081 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:52:02.110463 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.110419 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:52:02.110886 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.110537 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:52:02.115619 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.115588 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:52:02.547478 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.547447 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:52:02.594515 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.594473 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b65d8ffc7-thwts"] Sep 08 08:52:02.737701 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.737655 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:52:02.838264 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.838167 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:52:02.938251 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:02.938213 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:52:27.617820 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.617731 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b65d8ffc7-thwts" podUID="f308d12d-134b-438d-8b42-e6518e8ec922" containerName="console" containerID="cri-o://052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799" gracePeriod=15 Sep 08 08:52:27.874882 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.874804 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:52:27.963066 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963024 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-oauth-serving-cert\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963260 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963096 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-service-ca\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963260 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963115 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2rk5\" (UniqueName: \"kubernetes.io/projected/f308d12d-134b-438d-8b42-e6518e8ec922-kube-api-access-x2rk5\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963260 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963144 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-trusted-ca-bundle\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963438 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963264 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-console-config\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963438 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963337 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-oauth-config\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963438 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963370 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-serving-cert\") pod \"f308d12d-134b-438d-8b42-e6518e8ec922\" (UID: \"f308d12d-134b-438d-8b42-e6518e8ec922\") " Sep 08 08:52:27.963573 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963549 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-service-ca" (OuterVolumeSpecName: "service-ca") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:52:27.963621 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963468 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:52:27.963669 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963655 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:27.963711 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963675 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:27.963711 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963675 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-console-config" (OuterVolumeSpecName: "console-config") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:52:27.963711 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.963697 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:52:27.965350 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.965319 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f308d12d-134b-438d-8b42-e6518e8ec922-kube-api-access-x2rk5" (OuterVolumeSpecName: "kube-api-access-x2rk5") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "kube-api-access-x2rk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:52:27.965551 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.965530 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:52:27.965694 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:27.965679 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f308d12d-134b-438d-8b42-e6518e8ec922" (UID: "f308d12d-134b-438d-8b42-e6518e8ec922"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:52:28.064513 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.064454 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:28.064513 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.064501 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f308d12d-134b-438d-8b42-e6518e8ec922-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:28.064513 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.064511 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:28.064513 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.064520 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f308d12d-134b-438d-8b42-e6518e8ec922-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:28.064513 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.064531 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2rk5\" (UniqueName: \"kubernetes.io/projected/f308d12d-134b-438d-8b42-e6518e8ec922-kube-api-access-x2rk5\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:52:28.646568 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.646525 2561 generic.go:356] "Generic (PLEG): container finished" podID="f308d12d-134b-438d-8b42-e6518e8ec922" containerID="052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799" exitCode=0 Sep 08 08:52:28.647028 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.646579 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b65d8ffc7-thwts" Sep 08 08:52:28.647028 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.646613 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65d8ffc7-thwts" event={"ID":"f308d12d-134b-438d-8b42-e6518e8ec922","Type":"ContainerDied","Data":"052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799"} Sep 08 08:52:28.647028 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.646658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b65d8ffc7-thwts" event={"ID":"f308d12d-134b-438d-8b42-e6518e8ec922","Type":"ContainerDied","Data":"888d37c8f1b5744af5fd3815f9a3c74e7adf9c0f7668ad9437b6e2084ea22af5"} Sep 08 08:52:28.647028 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.646678 2561 scope.go:117] "RemoveContainer" containerID="052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799" Sep 08 08:52:28.655808 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.655780 2561 scope.go:117] "RemoveContainer" containerID="052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799" Sep 08 08:52:28.656198 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:52:28.656176 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799\": container with ID starting with 052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799 not found: ID does not exist" containerID="052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799" Sep 08 08:52:28.656256 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.656209 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799"} err="failed to get container status \"052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799\": rpc error: code = NotFound desc = could not find container \"052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799\": container with ID starting with 052f3dd5fd41f969f2d7531661f94c17d8ccc85d7004ff8c4402fa6d2ec18799 not found: ID does not exist" Sep 08 08:52:28.663401 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.663367 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b65d8ffc7-thwts"] Sep 08 08:52:28.668406 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:28.668372 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b65d8ffc7-thwts"] Sep 08 08:52:30.212940 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:30.212907 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f308d12d-134b-438d-8b42-e6518e8ec922" path="/var/lib/kubelet/pods/f308d12d-134b-438d-8b42-e6518e8ec922/volumes" Sep 08 08:52:36.120139 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:52:36.120094 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 08:54:23.602329 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:23.602282 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:54:24.504517 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.504479 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4"] Sep 08 08:54:24.504826 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.504813 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f308d12d-134b-438d-8b42-e6518e8ec922" containerName="console" Sep 08 08:54:24.504875 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.504828 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f308d12d-134b-438d-8b42-e6518e8ec922" containerName="console" Sep 08 08:54:24.504909 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.504884 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f308d12d-134b-438d-8b42-e6518e8ec922" containerName="console" Sep 08 08:54:24.507774 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.507735 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:24.510197 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.510164 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 08:54:24.510950 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.510930 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 08:54:24.511030 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.510987 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-5xr48\"" Sep 08 08:54:24.517894 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.517859 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhc8b\" (UniqueName: \"kubernetes.io/projected/e3aa172a-bca5-4402-b4f3-dedb4dbeb128-kube-api-access-mhc8b\") pod \"feast-operator-controller-manager-8474b64bd-l74v4\" (UID: \"e3aa172a-bca5-4402-b4f3-dedb4dbeb128\") " pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:24.525404 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.525367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4"] Sep 08 08:54:24.619157 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.619084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhc8b\" (UniqueName: \"kubernetes.io/projected/e3aa172a-bca5-4402-b4f3-dedb4dbeb128-kube-api-access-mhc8b\") pod \"feast-operator-controller-manager-8474b64bd-l74v4\" (UID: \"e3aa172a-bca5-4402-b4f3-dedb4dbeb128\") " pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:24.627482 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.627447 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhc8b\" (UniqueName: \"kubernetes.io/projected/e3aa172a-bca5-4402-b4f3-dedb4dbeb128-kube-api-access-mhc8b\") pod \"feast-operator-controller-manager-8474b64bd-l74v4\" (UID: \"e3aa172a-bca5-4402-b4f3-dedb4dbeb128\") " pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:24.819064 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:24.819028 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:25.092549 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:25.092449 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4"] Sep 08 08:54:25.095577 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:54:25.095547 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3aa172a_bca5_4402_b4f3_dedb4dbeb128.slice/crio-01d92441a2f5fd51f0bf0aeddeb135424c89eef9edf854a6cf08f7e617ee0fad WatchSource:0}: Error finding container 01d92441a2f5fd51f0bf0aeddeb135424c89eef9edf854a6cf08f7e617ee0fad: Status 404 returned error can't find the container with id 01d92441a2f5fd51f0bf0aeddeb135424c89eef9edf854a6cf08f7e617ee0fad Sep 08 08:54:25.097739 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:25.097715 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 08:54:26.098924 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:26.098883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" event={"ID":"e3aa172a-bca5-4402-b4f3-dedb4dbeb128","Type":"ContainerStarted","Data":"01d92441a2f5fd51f0bf0aeddeb135424c89eef9edf854a6cf08f7e617ee0fad"} Sep 08 08:54:26.742601 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:26.742563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:54:31.121502 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:31.121454 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" event={"ID":"e3aa172a-bca5-4402-b4f3-dedb4dbeb128","Type":"ContainerStarted","Data":"4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921"} Sep 08 08:54:31.121970 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:31.121570 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:31.151674 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:31.151613 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" podStartSLOduration=1.8845290559999999 podStartE2EDuration="7.151589688s" totalImagesPullingTime="5.267060632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:54:31.149567198 +0000 UTC m=+415.467023415" watchObservedRunningTime="2026-09-08 08:54:31.151589688 +0000 UTC m=+415.469045905" Sep 08 08:54:34.969633 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:34.969592 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6755f56697-5rkxw"] Sep 08 08:54:34.973048 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:34.973017 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:34.994831 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:34.994786 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6755f56697-5rkxw"] Sep 08 08:54:35.007395 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-trusted-ca-bundle\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.007553 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl74n\" (UniqueName: \"kubernetes.io/projected/ed12d6ec-8a5d-4f0e-9358-def6be42e954-kube-api-access-cl74n\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.007553 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-oauth-serving-cert\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.007553 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-config\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.007553 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007549 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-oauth-config\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.007709 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-serving-cert\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.007709 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.007635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-service-ca\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108109 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl74n\" (UniqueName: \"kubernetes.io/projected/ed12d6ec-8a5d-4f0e-9358-def6be42e954-kube-api-access-cl74n\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108109 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-oauth-serving-cert\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108349 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-config\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108349 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108160 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-oauth-config\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108349 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-serving-cert\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108349 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108223 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-service-ca\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108349 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108258 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-trusted-ca-bundle\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.108974 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.108948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-oauth-serving-cert\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.109091 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.109042 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-service-ca\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.109091 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.109051 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-config\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.109303 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.109283 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed12d6ec-8a5d-4f0e-9358-def6be42e954-trusted-ca-bundle\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.110931 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.110903 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-oauth-config\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.111017 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.111004 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed12d6ec-8a5d-4f0e-9358-def6be42e954-console-serving-cert\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.131639 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.131606 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:54:35.142217 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.142181 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl74n\" (UniqueName: \"kubernetes.io/projected/ed12d6ec-8a5d-4f0e-9358-def6be42e954-kube-api-access-cl74n\") pod \"console-6755f56697-5rkxw\" (UID: \"ed12d6ec-8a5d-4f0e-9358-def6be42e954\") " pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.268774 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.268700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:54:35.283172 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.283122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:35.566792 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.566665 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6755f56697-5rkxw"] Sep 08 08:54:35.572989 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:54:35.572956 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded12d6ec_8a5d_4f0e_9358_def6be42e954.slice/crio-9fc161bf0ec607ce49ada437e0226acfe5987987afd53c2aa7d06f5905f0328d WatchSource:0}: Error finding container 9fc161bf0ec607ce49ada437e0226acfe5987987afd53c2aa7d06f5905f0328d: Status 404 returned error can't find the container with id 9fc161bf0ec607ce49ada437e0226acfe5987987afd53c2aa7d06f5905f0328d Sep 08 08:54:35.770462 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:35.770394 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:54:36.142969 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:36.142928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6755f56697-5rkxw" event={"ID":"ed12d6ec-8a5d-4f0e-9358-def6be42e954","Type":"ContainerStarted","Data":"9973aea5ef9a7fd92d8d3b7f8b4d0c5c663e3a0f0c63319e3ad0c5d8c24c93da"} Sep 08 08:54:36.143461 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:36.142991 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6755f56697-5rkxw" event={"ID":"ed12d6ec-8a5d-4f0e-9358-def6be42e954","Type":"ContainerStarted","Data":"9fc161bf0ec607ce49ada437e0226acfe5987987afd53c2aa7d06f5905f0328d"} Sep 08 08:54:36.166387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:36.166327 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6755f56697-5rkxw" podStartSLOduration=2.166307392 podStartE2EDuration="2.166307392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:54:36.164900162 +0000 UTC m=+420.482356382" watchObservedRunningTime="2026-09-08 08:54:36.166307392 +0000 UTC m=+420.483763609" Sep 08 08:54:42.128509 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:42.128472 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 08:54:45.283673 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:45.283632 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:45.284100 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:45.283697 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:45.288841 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:45.288810 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:46.189800 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:46.189764 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6755f56697-5rkxw" Sep 08 08:54:46.301933 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:46.301887 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786b55bdf9-7hbpz"] Sep 08 08:54:46.504358 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:46.504262 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:54:46.642593 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:54:46.642552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:03.514471 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:03.514387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:03.640620 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:03.640579 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:04.216558 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.216521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:04.340116 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.340074 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:04.464892 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.464848 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb"] Sep 08 08:55:04.469431 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.469372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.474204 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.474176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 08:55:04.474370 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.474176 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 08:55:04.475683 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.475656 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 08:55:04.478087 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.477897 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 08 08:55:04.478087 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.477898 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 08:55:04.478087 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.477947 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 08:55:04.478087 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.477957 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 08:55:04.478087 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.477961 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-smd74\"" Sep 08 08:55:04.497436 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.497393 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb"] Sep 08 08:55:04.513216 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.513172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:04.565631 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.565589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-registry-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.565631 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.565632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh5v\" (UniqueName: \"kubernetes.io/projected/02c91ae6-1185-4aec-a727-6da743979c9f-kube-api-access-2kh5v\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.566218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.565710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-offline-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.566218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.565808 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-online-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.566218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.565835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.566218 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.565869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c91ae6-1185-4aec-a727-6da743979c9f-feast-data\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.618579 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.618533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:04.666711 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.666664 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-registry-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.666711 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.666714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh5v\" (UniqueName: \"kubernetes.io/projected/02c91ae6-1185-4aec-a727-6da743979c9f-kube-api-access-2kh5v\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.667016 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.666768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-offline-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.667016 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.666806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-online-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.667016 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.666827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.667016 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.666867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c91ae6-1185-4aec-a727-6da743979c9f-feast-data\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.667016 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:55:04.666975 2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 08 08:55:04.667275 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:55:04.667071 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls podName:02c91ae6-1185-4aec-a727-6da743979c9f nodeName:}" failed. No retries permitted until 2026-09-08 08:55:05.167049352 +0000 UTC m=+449.484505549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls") pod "feast-simple-feast-setup-7bc655655f-f94fb" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f") : secret "feast-simple-feast-setup-ui-tls" not found Sep 08 08:55:04.667380 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.667356 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c91ae6-1185-4aec-a727-6da743979c9f-feast-data\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.669533 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.669502 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-offline-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.669690 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.669637 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-registry-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.669690 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.669648 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-online-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.688387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.688351 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh5v\" (UniqueName: \"kubernetes.io/projected/02c91ae6-1185-4aec-a727-6da743979c9f-kube-api-access-2kh5v\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:04.753506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:04.753395 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:05.062757 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:05.062700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:55:05.170707 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:05.170663 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:05.173184 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:05.173145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-f94fb\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:05.388507 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:05.388397 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:05.707134 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:05.707044 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb"] Sep 08 08:55:05.709588 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:55:05.709561 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02c91ae6_1185_4aec_a727_6da743979c9f.slice/crio-3540ed3872bfa4d50e4cc848dc642f4a083e090a0eccdbd51519a44b7aa0d4dc WatchSource:0}: Error finding container 3540ed3872bfa4d50e4cc848dc642f4a083e090a0eccdbd51519a44b7aa0d4dc: Status 404 returned error can't find the container with id 3540ed3872bfa4d50e4cc848dc642f4a083e090a0eccdbd51519a44b7aa0d4dc Sep 08 08:55:06.266878 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:06.266841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"3540ed3872bfa4d50e4cc848dc642f4a083e090a0eccdbd51519a44b7aa0d4dc"} Sep 08 08:55:11.327473 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.327421 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-786b55bdf9-7hbpz" podUID="b57ffc52-b0b6-46a7-86a8-bdedea06d979" containerName="console" containerID="cri-o://00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d" gracePeriod=15 Sep 08 08:55:11.592066 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.591989 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:55:11.734385 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734345 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-trusted-ca-bundle\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734385 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734404 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-service-ca\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734441 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-oauth-serving-cert\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734459 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7956\" (UniqueName: \"kubernetes.io/projected/b57ffc52-b0b6-46a7-86a8-bdedea06d979-kube-api-access-h7956\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734510 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-serving-cert\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734537 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-oauth-config\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734656 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734587 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-config\") pod \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\" (UID: \"b57ffc52-b0b6-46a7-86a8-bdedea06d979\") " Sep 08 08:55:11.734909 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734879 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:55:11.734955 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734929 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:55:11.734991 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.734954 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-service-ca" (OuterVolumeSpecName: "service-ca") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:55:11.735508 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.735443 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-config" (OuterVolumeSpecName: "console-config") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 08:55:11.737332 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.737289 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:55:11.737529 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.737504 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b57ffc52-b0b6-46a7-86a8-bdedea06d979-kube-api-access-h7956" (OuterVolumeSpecName: "kube-api-access-h7956") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "kube-api-access-h7956". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:55:11.737712 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.737677 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b57ffc52-b0b6-46a7-86a8-bdedea06d979" (UID: "b57ffc52-b0b6-46a7-86a8-bdedea06d979"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:55:11.836254 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836211 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:11.836254 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836253 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:11.836488 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836269 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:11.836488 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836282 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7956\" (UniqueName: \"kubernetes.io/projected/b57ffc52-b0b6-46a7-86a8-bdedea06d979-kube-api-access-h7956\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:11.836488 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836294 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:11.836488 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836307 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:11.836488 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:11.836321 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b57ffc52-b0b6-46a7-86a8-bdedea06d979-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:55:12.298272 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.298232 2561 generic.go:356] "Generic (PLEG): container finished" podID="b57ffc52-b0b6-46a7-86a8-bdedea06d979" containerID="00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d" exitCode=0 Sep 08 08:55:12.298482 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.298286 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b55bdf9-7hbpz" Sep 08 08:55:12.298482 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.298285 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b55bdf9-7hbpz" event={"ID":"b57ffc52-b0b6-46a7-86a8-bdedea06d979","Type":"ContainerDied","Data":"00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d"} Sep 08 08:55:12.298482 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.298416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b55bdf9-7hbpz" event={"ID":"b57ffc52-b0b6-46a7-86a8-bdedea06d979","Type":"ContainerDied","Data":"9c35cc277939eef201025bd634ae46c5f183f738e3b2f2ebb05c2306c4c102a1"} Sep 08 08:55:12.298482 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.298445 2561 scope.go:117] "RemoveContainer" containerID="00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d" Sep 08 08:55:12.309042 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.309002 2561 scope.go:117] "RemoveContainer" containerID="00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d" Sep 08 08:55:12.309421 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:55:12.309398 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d\": container with ID starting with 00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d not found: ID does not exist" containerID="00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d" Sep 08 08:55:12.309514 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.309430 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d"} err="failed to get container status \"00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d\": rpc error: code = NotFound desc = could not find container \"00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d\": container with ID starting with 00e80cbb7a4a96cf2198bd1ed0052a55295adb62509917f705b521f01fdf1d5d not found: ID does not exist" Sep 08 08:55:12.330895 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.330854 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786b55bdf9-7hbpz"] Sep 08 08:55:12.337725 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:12.337680 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786b55bdf9-7hbpz"] Sep 08 08:55:14.213998 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:14.213955 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b57ffc52-b0b6-46a7-86a8-bdedea06d979" path="/var/lib/kubelet/pods/b57ffc52-b0b6-46a7-86a8-bdedea06d979/volumes" Sep 08 08:55:31.385738 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:31.385693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"3f1e267cbc0cbcdf786ada9808bb4a102e77ed87df585ac92f68c33d8ecb978b"} Sep 08 08:55:36.409225 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:36.409189 2561 generic.go:356] "Generic (PLEG): container finished" podID="02c91ae6-1185-4aec-a727-6da743979c9f" containerID="3f1e267cbc0cbcdf786ada9808bb4a102e77ed87df585ac92f68c33d8ecb978b" exitCode=0 Sep 08 08:55:36.409654 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:36.409269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"3f1e267cbc0cbcdf786ada9808bb4a102e77ed87df585ac92f68c33d8ecb978b"} Sep 08 08:55:37.416773 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:37.416702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"f467e24c0427bfe1d6faf8c8bca8eaffaf2e4a2e4354784c0c69a9e13e5a9460"} Sep 08 08:55:43.453385 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:43.453345 2561 generic.go:356] "Generic (PLEG): container finished" podID="02c91ae6-1185-4aec-a727-6da743979c9f" containerID="f467e24c0427bfe1d6faf8c8bca8eaffaf2e4a2e4354784c0c69a9e13e5a9460" exitCode=0 Sep 08 08:55:43.453796 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:43.453409 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"f467e24c0427bfe1d6faf8c8bca8eaffaf2e4a2e4354784c0c69a9e13e5a9460"} Sep 08 08:55:43.464500 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:43.464467 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 08 08:55:44.464416 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:44.464306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"020a8b6966e4ff090f84cb60f53b3fc25811108be6fc54e9bc62e03aa0b185a2"} Sep 08 08:55:44.464416 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:44.464371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"7b2230a1df287152a800fcd4c1d8e731dc05973065722c4458ce22957363288e"} Sep 08 08:55:44.464416 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:44.464391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"bc79b2c81452f0be137e74912ac4e8f99810cc865098c63fb4b8cb4661ef5c1b"} Sep 08 08:55:44.464416 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:44.464410 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerStarted","Data":"ca7bdae900919e1c866f6850f1f78a44c7a78b20df9cdf4cc74d23286cb7e8b0"} Sep 08 08:55:44.498977 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:44.498898 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podStartSLOduration=15.74382816 podStartE2EDuration="40.498872635s" totalImagesPullingTime="24.755044475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:55:44.495125248 +0000 UTC m=+488.812581496" watchObservedRunningTime="2026-09-08 08:55:44.498872635 +0000 UTC m=+488.816328854" Sep 08 08:55:45.389114 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:45.389067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:45.389346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:45.389156 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:45.389346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:45.389212 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:45.389346 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:45.389232 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:47.390252 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.390217 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:47.390910 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.390276 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:47.390910 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.390294 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:47.390910 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.390596 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:47.391115 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.390933 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 08 08:55:47.391297 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.391261 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 08 08:55:47.391434 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.391353 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused" Sep 08 08:55:47.391434 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:47.391395 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused" Sep 08 08:55:50.389845 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:50.389799 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 08 08:55:50.390604 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:50.389791 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused" Sep 08 08:55:50.390604 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:50.389796 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 08 08:55:50.390604 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:50.389862 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused" Sep 08 08:55:53.390029 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.389997 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.390503 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.390101 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.390503 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.390363 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.390985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.390949 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.391106 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.391021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.391327 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.391304 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.395630 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.395602 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.528436 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.528405 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:55:53.837179 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:55:53.837145 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:13.101605 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:13.101562 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:56.542084 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.542044 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:56.569736 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.569697 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb"] Sep 08 08:56:56.570101 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.570058 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="registry" containerID="cri-o://ca7bdae900919e1c866f6850f1f78a44c7a78b20df9cdf4cc74d23286cb7e8b0" gracePeriod=30 Sep 08 08:56:56.570209 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.570180 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="offline" containerID="cri-o://7b2230a1df287152a800fcd4c1d8e731dc05973065722c4458ce22957363288e" gracePeriod=30 Sep 08 08:56:56.570276 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.570194 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" containerID="cri-o://bc79b2c81452f0be137e74912ac4e8f99810cc865098c63fb4b8cb4661ef5c1b" gracePeriod=30 Sep 08 08:56:56.570821 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.570732 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" containerID="cri-o://020a8b6966e4ff090f84cb60f53b3fc25811108be6fc54e9bc62e03aa0b185a2" gracePeriod=30 Sep 08 08:56:56.636055 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.636012 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:56.828061 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.827930 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:56.929257 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.929217 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:56.973196 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.973160 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp"] Sep 08 08:56:56.973673 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.973657 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b57ffc52-b0b6-46a7-86a8-bdedea06d979" containerName="console" Sep 08 08:56:56.973735 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.973676 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b57ffc52-b0b6-46a7-86a8-bdedea06d979" containerName="console" Sep 08 08:56:56.973829 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.973774 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b57ffc52-b0b6-46a7-86a8-bdedea06d979" containerName="console" Sep 08 08:56:56.978051 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.978020 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:56.981040 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.981016 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9phf7\"" Sep 08 08:56:56.997844 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:56.997807 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp"] Sep 08 08:56:57.027120 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.027055 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:57.066270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.066224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-feast-data\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.066270 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.066276 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-offline-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.066500 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.066405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.066551 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.066505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n9x9\" (UniqueName: \"kubernetes.io/projected/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-kube-api-access-8n9x9\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.066607 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.066567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-online-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.066651 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.066602 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-registry-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.119939 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.119818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:57.168024 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.167973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-registry-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.168228 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.168062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-feast-data\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.168228 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.168098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-offline-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.168228 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.168155 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.168228 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.168200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n9x9\" (UniqueName: \"kubernetes.io/projected/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-kube-api-access-8n9x9\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.168433 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.168251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-online-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.168537 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.168507 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-feast-data\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.170985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.170957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-registry-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.171168 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.171060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-online-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.171238 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.171181 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-ui-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.171483 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.171460 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-offline-tls\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.178417 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.178269 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n9x9\" (UniqueName: \"kubernetes.io/projected/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-kube-api-access-8n9x9\") pod \"feast-simple-feast-setup-7bc655655f-4qbcp\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.220587 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.220547 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:56:57.289593 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.289537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:56:57.578374 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.578338 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp"] Sep 08 08:56:57.581377 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:56:57.581343 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae68d5d6_7a3b_47ca_81da_98ec43b09a11.slice/crio-26c9938eff80bb86c3acdbafbccffcf83882b275f3545cbedebfc198b8eebda8 WatchSource:0}: Error finding container 26c9938eff80bb86c3acdbafbccffcf83882b275f3545cbedebfc198b8eebda8: Status 404 returned error can't find the container with id 26c9938eff80bb86c3acdbafbccffcf83882b275f3545cbedebfc198b8eebda8 Sep 08 08:56:57.783354 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.783318 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"b09dbc69b3dd9582c6946f36d20ec79d320a156952e1da0d8c02e5ee4f81757b"} Sep 08 08:56:57.783554 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.783376 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"26c9938eff80bb86c3acdbafbccffcf83882b275f3545cbedebfc198b8eebda8"} Sep 08 08:56:57.786647 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.786600 2561 generic.go:356] "Generic (PLEG): container finished" podID="02c91ae6-1185-4aec-a727-6da743979c9f" containerID="020a8b6966e4ff090f84cb60f53b3fc25811108be6fc54e9bc62e03aa0b185a2" exitCode=0 Sep 08 08:56:57.786647 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.786628 2561 generic.go:356] "Generic (PLEG): container finished" podID="02c91ae6-1185-4aec-a727-6da743979c9f" containerID="bc79b2c81452f0be137e74912ac4e8f99810cc865098c63fb4b8cb4661ef5c1b" exitCode=0 Sep 08 08:56:57.786880 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.786660 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"020a8b6966e4ff090f84cb60f53b3fc25811108be6fc54e9bc62e03aa0b185a2"} Sep 08 08:56:57.786880 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:56:57.786706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"bc79b2c81452f0be137e74912ac4e8f99810cc865098c63fb4b8cb4661ef5c1b"} Sep 08 08:57:03.390985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:03.390870 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 08 08:57:03.525265 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:03.525221 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 08 08:57:03.813680 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:03.813646 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerID="b09dbc69b3dd9582c6946f36d20ec79d320a156952e1da0d8c02e5ee4f81757b" exitCode=0 Sep 08 08:57:03.813870 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:03.813692 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"b09dbc69b3dd9582c6946f36d20ec79d320a156952e1da0d8c02e5ee4f81757b"} Sep 08 08:57:04.819735 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:04.819690 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"e604dba1c39fbe2da9191f8fac768c526c14c615cd148c7163abb104287d6f58"} Sep 08 08:57:10.847929 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:10.847893 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerID="e604dba1c39fbe2da9191f8fac768c526c14c615cd148c7163abb104287d6f58" exitCode=0 Sep 08 08:57:10.848298 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:10.847936 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"e604dba1c39fbe2da9191f8fac768c526c14c615cd148c7163abb104287d6f58"} Sep 08 08:57:11.859214 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:11.859170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"5ae0110e60a55cbdeb6147171fc12a43f1bb43fc562bc898156861045fd6e73b"} Sep 08 08:57:11.859677 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:11.859238 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"fe4eb04fdb4048ddd95f17f52704332ee93134b61fb1221eb8641af2eab72345"} Sep 08 08:57:11.859677 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:11.859259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"d9cc10631bb8d72cadd69a514a6a6bd5efb6244b0bf1a2e12e7eadbc8a15f1a1"} Sep 08 08:57:11.859677 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:11.859277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerStarted","Data":"09d959a6c6feb1dfba47d1003e137c04482581eedef1135e47d618a3b87e9eff"} Sep 08 08:57:11.886296 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:11.886219 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podStartSLOduration=15.886182339 podStartE2EDuration="15.886182339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:57:11.884807521 +0000 UTC m=+576.202263748" watchObservedRunningTime="2026-09-08 08:57:11.886182339 +0000 UTC m=+576.203638565" Sep 08 08:57:12.290759 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.290688 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:12.290962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.290792 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:12.290962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.290822 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:12.290962 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.290842 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:12.293104 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.293048 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 08 08:57:12.293275 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.293095 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 08 08:57:12.293275 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.293099 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 08 08:57:12.293275 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:12.293220 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 08 08:57:13.391541 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:13.391494 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 08 08:57:13.525639 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:13.525584 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 08 08:57:15.290684 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:15.290636 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 08 08:57:15.291285 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:15.290683 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 08 08:57:15.291350 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:15.290706 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 08 08:57:15.291350 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:15.290714 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 08 08:57:17.290419 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:17.290367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:17.290937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:17.290451 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:17.290937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:17.290472 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:17.290937 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:17.290494 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:18.289979 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:18.289921 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused" Sep 08 08:57:18.290324 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:18.289948 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 08 08:57:18.290477 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:18.289963 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 08 08:57:18.290477 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:18.290003 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 08 08:57:21.291287 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.291244 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.291876 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.291849 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.292049 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.292032 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.292267 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.292246 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.297387 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.297356 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.918570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.918525 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.918908 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.918692 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:21.922197 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:21.922157 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 08:57:22.271596 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:22.271555 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:57:23.391683 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:23.391639 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 08 08:57:23.392181 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:23.391795 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:57:23.524992 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:23.524950 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 08 08:57:23.525176 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:23.525068 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:57:26.942045 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:26.941955 2561 generic.go:356] "Generic (PLEG): container finished" podID="02c91ae6-1185-4aec-a727-6da743979c9f" containerID="7b2230a1df287152a800fcd4c1d8e731dc05973065722c4458ce22957363288e" exitCode=137 Sep 08 08:57:26.942045 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:26.941982 2561 generic.go:356] "Generic (PLEG): container finished" podID="02c91ae6-1185-4aec-a727-6da743979c9f" containerID="ca7bdae900919e1c866f6850f1f78a44c7a78b20df9cdf4cc74d23286cb7e8b0" exitCode=137 Sep 08 08:57:26.942045 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:26.942022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"7b2230a1df287152a800fcd4c1d8e731dc05973065722c4458ce22957363288e"} Sep 08 08:57:26.942506 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:26.942067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"ca7bdae900919e1c866f6850f1f78a44c7a78b20df9cdf4cc74d23286cb7e8b0"} Sep 08 08:57:27.237503 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.237468 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:57:27.338038 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.337983 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c91ae6-1185-4aec-a727-6da743979c9f-feast-data\") pod \"02c91ae6-1185-4aec-a727-6da743979c9f\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " Sep 08 08:57:27.338038 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.338039 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-offline-tls\") pod \"02c91ae6-1185-4aec-a727-6da743979c9f\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " Sep 08 08:57:27.338286 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.338086 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls\") pod \"02c91ae6-1185-4aec-a727-6da743979c9f\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " Sep 08 08:57:27.338286 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.338119 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-registry-tls\") pod \"02c91ae6-1185-4aec-a727-6da743979c9f\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " Sep 08 08:57:27.338286 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.338265 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kh5v\" (UniqueName: \"kubernetes.io/projected/02c91ae6-1185-4aec-a727-6da743979c9f-kube-api-access-2kh5v\") pod \"02c91ae6-1185-4aec-a727-6da743979c9f\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " Sep 08 08:57:27.338436 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.338318 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-online-tls\") pod \"02c91ae6-1185-4aec-a727-6da743979c9f\" (UID: \"02c91ae6-1185-4aec-a727-6da743979c9f\") " Sep 08 08:57:27.338643 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.338606 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c91ae6-1185-4aec-a727-6da743979c9f-feast-data" (OuterVolumeSpecName: "feast-data") pod "02c91ae6-1185-4aec-a727-6da743979c9f" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 08:57:27.340549 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.340509 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-online-tls" (OuterVolumeSpecName: "online-tls") pod "02c91ae6-1185-4aec-a727-6da743979c9f" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:57:27.340549 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.340526 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c91ae6-1185-4aec-a727-6da743979c9f-kube-api-access-2kh5v" (OuterVolumeSpecName: "kube-api-access-2kh5v") pod "02c91ae6-1185-4aec-a727-6da743979c9f" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f"). InnerVolumeSpecName "kube-api-access-2kh5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 08:57:27.340549 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.340539 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "02c91ae6-1185-4aec-a727-6da743979c9f" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:57:27.340795 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.340764 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "02c91ae6-1185-4aec-a727-6da743979c9f" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:57:27.340846 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.340823 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "02c91ae6-1185-4aec-a727-6da743979c9f" (UID: "02c91ae6-1185-4aec-a727-6da743979c9f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 08:57:27.438985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.438942 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:57:27.438985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.438977 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kh5v\" (UniqueName: \"kubernetes.io/projected/02c91ae6-1185-4aec-a727-6da743979c9f-kube-api-access-2kh5v\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:57:27.438985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.438988 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-online-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:57:27.438985 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.438997 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c91ae6-1185-4aec-a727-6da743979c9f-feast-data\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:57:27.439252 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.439004 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-offline-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:57:27.439252 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.439012 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c91ae6-1185-4aec-a727-6da743979c9f-ui-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 08:57:27.949289 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.949243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" event={"ID":"02c91ae6-1185-4aec-a727-6da743979c9f","Type":"ContainerDied","Data":"3540ed3872bfa4d50e4cc848dc642f4a083e090a0eccdbd51519a44b7aa0d4dc"} Sep 08 08:57:27.949838 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.949307 2561 scope.go:117] "RemoveContainer" containerID="020a8b6966e4ff090f84cb60f53b3fc25811108be6fc54e9bc62e03aa0b185a2" Sep 08 08:57:27.949838 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.949322 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb" Sep 08 08:57:27.959298 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.959276 2561 scope.go:117] "RemoveContainer" containerID="7b2230a1df287152a800fcd4c1d8e731dc05973065722c4458ce22957363288e" Sep 08 08:57:27.967721 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.967697 2561 scope.go:117] "RemoveContainer" containerID="bc79b2c81452f0be137e74912ac4e8f99810cc865098c63fb4b8cb4661ef5c1b" Sep 08 08:57:27.972623 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.972587 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb"] Sep 08 08:57:27.977332 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.977303 2561 scope.go:117] "RemoveContainer" containerID="ca7bdae900919e1c866f6850f1f78a44c7a78b20df9cdf4cc74d23286cb7e8b0" Sep 08 08:57:27.981349 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.981317 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-f94fb"] Sep 08 08:57:27.986566 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.986538 2561 scope.go:117] "RemoveContainer" containerID="f467e24c0427bfe1d6faf8c8bca8eaffaf2e4a2e4354784c0c69a9e13e5a9460" Sep 08 08:57:27.995042 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:27.995014 2561 scope.go:117] "RemoveContainer" containerID="3f1e267cbc0cbcdf786ada9808bb4a102e77ed87df585ac92f68c33d8ecb978b" Sep 08 08:57:28.212667 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:57:28.212588 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" path="/var/lib/kubelet/pods/02c91ae6-1185-4aec-a727-6da743979c9f/volumes" Sep 08 08:58:23.408458 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.408417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:23.509363 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.509327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:23.852732 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.852692 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:23.952556 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.952505 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:23.969345 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969307 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8"] Sep 08 08:58:23.969776 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969732 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="registry" Sep 08 08:58:23.969830 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969779 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="registry" Sep 08 08:58:23.969830 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969793 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" Sep 08 08:58:23.969830 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969803 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" Sep 08 08:58:23.969830 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969823 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="feast-init" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969832 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="feast-init" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969841 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969849 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969862 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="offline" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969870 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="offline" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969897 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="feast-apply" Sep 08 08:58:23.969953 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969904 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="feast-apply" Sep 08 08:58:23.970154 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969976 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="offline" Sep 08 08:58:23.970154 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969987 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="registry" Sep 08 08:58:23.970154 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.969999 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="ui" Sep 08 08:58:23.970154 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.970008 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c91ae6-1185-4aec-a727-6da743979c9f" containerName="online" Sep 08 08:58:23.974071 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.974042 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:23.976835 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.976808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 08:58:23.977083 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.977054 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 08:58:23.977163 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.976806 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 08:58:23.977380 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.977039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 08 08:58:23.977380 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.977269 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9gqcx\"" Sep 08 08:58:23.977380 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.977367 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 08:58:23.978119 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.977907 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 08:58:23.978119 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.977931 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 08:58:23.986401 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:23.986367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8"] Sep 08 08:58:24.117081 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.116968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gf79\" (UniqueName: \"kubernetes.io/projected/a709ec36-b71f-4013-b81a-7bd22067e9fa-kube-api-access-8gf79\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.117081 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.117053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.117283 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.117115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-offline-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.117283 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.117160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a709ec36-b71f-4013-b81a-7bd22067e9fa-feast-data\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.117283 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.117214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a709ec36-b71f-4013-b81a-7bd22067e9fa-registry-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.117283 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.117253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.179228 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.179188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:24.218075 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a709ec36-b71f-4013-b81a-7bd22067e9fa-registry-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218269 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218269 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gf79\" (UniqueName: \"kubernetes.io/projected/a709ec36-b71f-4013-b81a-7bd22067e9fa-kube-api-access-8gf79\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218389 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:58:24.218266 2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 08 08:58:24.218389 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218297 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218389 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:58:24.218357 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls podName:a709ec36-b71f-4013-b81a-7bd22067e9fa nodeName:}" failed. No retries permitted until 2026-09-08 08:58:24.718334537 +0000 UTC m=+649.035790746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls") pod "feast-simple-feast-remote-setup-8685984685-99fh8" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 08 08:58:24.218622 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:58:24.218402 2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 08 08:58:24.218622 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-offline-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218622 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a709ec36-b71f-4013-b81a-7bd22067e9fa-feast-data\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218622 ip-10-0-132-205 kubenswrapper[2561]: E0908 08:58:24.218466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls podName:a709ec36-b71f-4013-b81a-7bd22067e9fa nodeName:}" failed. No retries permitted until 2026-09-08 08:58:24.718447906 +0000 UTC m=+649.035904116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls") pod "feast-simple-feast-remote-setup-8685984685-99fh8" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 08 08:58:24.218850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218804 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a709ec36-b71f-4013-b81a-7bd22067e9fa-feast-data\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.218850 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.218818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a709ec36-b71f-4013-b81a-7bd22067e9fa-registry-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.221364 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.221333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-offline-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.231293 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.231254 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gf79\" (UniqueName: \"kubernetes.io/projected/a709ec36-b71f-4013-b81a-7bd22067e9fa-kube-api-access-8gf79\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.723399 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.723347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.723854 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.723424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.726133 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.726102 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.726283 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.726148 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls\") pod \"feast-simple-feast-remote-setup-8685984685-99fh8\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:24.885903 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:24.885826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:58:25.174461 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:25.174431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8"] Sep 08 08:58:25.176297 ip-10-0-132-205 kubenswrapper[2561]: W0908 08:58:25.176258 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda709ec36_b71f_4013_b81a_7bd22067e9fa.slice/crio-9c3c9f77d964320bf900a96a9f1ee9617297d9522968d7055abe52d00d209634 WatchSource:0}: Error finding container 9c3c9f77d964320bf900a96a9f1ee9617297d9522968d7055abe52d00d209634: Status 404 returned error can't find the container with id 9c3c9f77d964320bf900a96a9f1ee9617297d9522968d7055abe52d00d209634 Sep 08 08:58:25.187181 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:25.187137 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerStarted","Data":"9c3c9f77d964320bf900a96a9f1ee9617297d9522968d7055abe52d00d209634"} Sep 08 08:58:26.193267 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:26.193227 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerStarted","Data":"0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8"} Sep 08 08:58:27.402191 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:27.402128 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:27.463792 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:27.463728 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:31.217631 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:31.217599 2561 generic.go:356] "Generic (PLEG): container finished" podID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerID="0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8" exitCode=0 Sep 08 08:58:31.218048 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:31.217679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerDied","Data":"0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8"} Sep 08 08:58:32.225269 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:32.225235 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerStarted","Data":"18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5"} Sep 08 08:58:47.112160 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:47.112108 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:58:58.342119 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:58.342075 2561 generic.go:356] "Generic (PLEG): container finished" podID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerID="18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5" exitCode=0 Sep 08 08:58:58.342545 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:58.342144 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerDied","Data":"18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5"} Sep 08 08:58:58.346736 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:58.346705 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 08 08:58:59.351229 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:59.351188 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerStarted","Data":"32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a"} Sep 08 08:58:59.351617 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:59.351256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerStarted","Data":"2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d"} Sep 08 08:58:59.351617 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:59.351277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerStarted","Data":"037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90"} Sep 08 08:58:59.376539 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:58:59.376464 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podStartSLOduration=36.376436266 podStartE2EDuration="36.376436266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 08:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 08:58:59.375387029 +0000 UTC m=+683.692843272" watchObservedRunningTime="2026-09-08 08:58:59.376436266 +0000 UTC m=+683.693892485" Sep 08 08:59:00.886675 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:00.886634 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:00.887203 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:00.886708 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:00.887203 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:00.886728 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:00.888587 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:00.888546 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Sep 08 08:59:00.888587 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:00.888571 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 08:59:00.888867 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:00.888546 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 08:59:03.603897 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:03.603859 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 08:59:03.886857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:03.886728 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 08:59:03.886857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:03.886730 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 08:59:03.886857 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:03.886728 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Sep 08 08:59:04.886965 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:04.886915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:04.887494 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:04.886993 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:04.887494 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:04.887015 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:06.886918 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:06.886871 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 08:59:06.887412 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:06.886872 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused" Sep 08 08:59:06.887412 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:06.886887 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 08:59:09.888023 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:09.887987 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:09.888512 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:09.888162 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:09.888904 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:09.888879 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:09.889198 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:09.889179 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:09.913115 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:09.913079 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:10.429570 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:10.429535 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 08:59:10.715848 ip-10-0-132-205 kubenswrapper[2561]: I0908 08:59:10.715700 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:00:12.199135 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.199095 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8"] Sep 08 09:00:12.199715 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.199665 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" containerID="cri-o://037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90" gracePeriod=30 Sep 08 09:00:12.199820 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.199739 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" containerID="cri-o://32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a" gracePeriod=30 Sep 08 09:00:12.199923 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.199764 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" containerID="cri-o://2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d" gracePeriod=30 Sep 08 09:00:12.301684 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.301645 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp"] Sep 08 09:00:12.302085 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.301962 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" containerID="cri-o://09d959a6c6feb1dfba47d1003e137c04482581eedef1135e47d618a3b87e9eff" gracePeriod=30 Sep 08 09:00:12.302085 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.302041 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" containerID="cri-o://fe4eb04fdb4048ddd95f17f52704332ee93134b61fb1221eb8641af2eab72345" gracePeriod=30 Sep 08 09:00:12.302268 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.302022 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" containerID="cri-o://d9cc10631bb8d72cadd69a514a6a6bd5efb6244b0bf1a2e12e7eadbc8a15f1a1" gracePeriod=30 Sep 08 09:00:12.302268 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.302022 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" containerID="cri-o://5ae0110e60a55cbdeb6147171fc12a43f1bb43fc562bc898156861045fd6e73b" gracePeriod=30 Sep 08 09:00:12.422087 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:12.422054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:00:13.685312 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.685278 2561 generic.go:356] "Generic (PLEG): container finished" podID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerID="32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a" exitCode=0 Sep 08 09:00:13.685312 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.685304 2561 generic.go:356] "Generic (PLEG): container finished" podID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerID="037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90" exitCode=0 Sep 08 09:00:13.685828 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.685349 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerDied","Data":"32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a"} Sep 08 09:00:13.685828 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.685397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerDied","Data":"037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90"} Sep 08 09:00:13.688657 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.688626 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerID="5ae0110e60a55cbdeb6147171fc12a43f1bb43fc562bc898156861045fd6e73b" exitCode=0 Sep 08 09:00:13.688657 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.688650 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerID="d9cc10631bb8d72cadd69a514a6a6bd5efb6244b0bf1a2e12e7eadbc8a15f1a1" exitCode=0 Sep 08 09:00:13.688879 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.688679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"5ae0110e60a55cbdeb6147171fc12a43f1bb43fc562bc898156861045fd6e73b"} Sep 08 09:00:13.688879 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:13.688709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"d9cc10631bb8d72cadd69a514a6a6bd5efb6244b0bf1a2e12e7eadbc8a15f1a1"} Sep 08 09:00:19.889338 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:19.889286 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 09:00:20.409029 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:20.408984 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 09:00:20.953949 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:20.953908 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:00:21.292680 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:21.292631 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 08 09:00:21.918645 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:21.918574 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 08 09:00:29.888895 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:29.888847 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 09:00:30.408453 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:30.408408 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 09:00:31.292347 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:31.292289 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 08 09:00:31.919079 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:31.919031 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 08 09:00:39.889284 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:39.889229 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused" Sep 08 09:00:39.889876 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:39.889412 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 09:00:40.408034 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:40.407988 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused" Sep 08 09:00:40.408248 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:40.408128 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 09:00:41.292182 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:41.292137 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 08 09:00:41.292584 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:41.292289 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 09:00:41.918510 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:41.918465 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 08 09:00:41.918764 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:41.918613 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 09:00:42.441772 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.441728 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 09:00:42.554347 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.554301 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gf79\" (UniqueName: \"kubernetes.io/projected/a709ec36-b71f-4013-b81a-7bd22067e9fa-kube-api-access-8gf79\") pod \"a709ec36-b71f-4013-b81a-7bd22067e9fa\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " Sep 08 09:00:42.554347 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.554344 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls\") pod \"a709ec36-b71f-4013-b81a-7bd22067e9fa\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " Sep 08 09:00:42.554666 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.554396 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a709ec36-b71f-4013-b81a-7bd22067e9fa-feast-data\") pod \"a709ec36-b71f-4013-b81a-7bd22067e9fa\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " Sep 08 09:00:42.554666 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.554435 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls\") pod \"a709ec36-b71f-4013-b81a-7bd22067e9fa\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " Sep 08 09:00:42.554666 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.554533 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-offline-tls\") pod \"a709ec36-b71f-4013-b81a-7bd22067e9fa\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " Sep 08 09:00:42.554666 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.554574 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a709ec36-b71f-4013-b81a-7bd22067e9fa-registry-tls\") pod \"a709ec36-b71f-4013-b81a-7bd22067e9fa\" (UID: \"a709ec36-b71f-4013-b81a-7bd22067e9fa\") " Sep 08 09:00:42.555053 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.555015 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a709ec36-b71f-4013-b81a-7bd22067e9fa-feast-data" (OuterVolumeSpecName: "feast-data") pod "a709ec36-b71f-4013-b81a-7bd22067e9fa" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:00:42.555177 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.555048 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a709ec36-b71f-4013-b81a-7bd22067e9fa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a709ec36-b71f-4013-b81a-7bd22067e9fa" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 09:00:42.556952 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.556917 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls" (OuterVolumeSpecName: "online-tls") pod "a709ec36-b71f-4013-b81a-7bd22067e9fa" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:42.556952 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.556936 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a709ec36-b71f-4013-b81a-7bd22067e9fa" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:42.557142 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.557076 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a709ec36-b71f-4013-b81a-7bd22067e9fa" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:42.557142 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.557084 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a709ec36-b71f-4013-b81a-7bd22067e9fa-kube-api-access-8gf79" (OuterVolumeSpecName: "kube-api-access-8gf79") pod "a709ec36-b71f-4013-b81a-7bd22067e9fa" (UID: "a709ec36-b71f-4013-b81a-7bd22067e9fa"). InnerVolumeSpecName "kube-api-access-8gf79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:00:42.655446 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.655395 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a709ec36-b71f-4013-b81a-7bd22067e9fa-feast-data\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:42.655446 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.655433 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-online-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:42.655446 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.655442 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-offline-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:42.655446 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.655450 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/a709ec36-b71f-4013-b81a-7bd22067e9fa-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:42.655446 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.655459 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gf79\" (UniqueName: \"kubernetes.io/projected/a709ec36-b71f-4013-b81a-7bd22067e9fa-kube-api-access-8gf79\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:42.655791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.655473 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a709ec36-b71f-4013-b81a-7bd22067e9fa-ui-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:42.813140 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.812994 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerID="fe4eb04fdb4048ddd95f17f52704332ee93134b61fb1221eb8641af2eab72345" exitCode=137 Sep 08 09:00:42.813140 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.813034 2561 generic.go:356] "Generic (PLEG): container finished" podID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerID="09d959a6c6feb1dfba47d1003e137c04482581eedef1135e47d618a3b87e9eff" exitCode=137 Sep 08 09:00:42.813140 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.813069 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"fe4eb04fdb4048ddd95f17f52704332ee93134b61fb1221eb8641af2eab72345"} Sep 08 09:00:42.813140 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.813131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"09d959a6c6feb1dfba47d1003e137c04482581eedef1135e47d618a3b87e9eff"} Sep 08 09:00:42.815739 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.815704 2561 generic.go:356] "Generic (PLEG): container finished" podID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerID="2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d" exitCode=137 Sep 08 09:00:42.815959 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.815783 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerDied","Data":"2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d"} Sep 08 09:00:42.815959 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.815833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" event={"ID":"a709ec36-b71f-4013-b81a-7bd22067e9fa","Type":"ContainerDied","Data":"9c3c9f77d964320bf900a96a9f1ee9617297d9522968d7055abe52d00d209634"} Sep 08 09:00:42.815959 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.815854 2561 scope.go:117] "RemoveContainer" containerID="32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a" Sep 08 09:00:42.815959 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.815789 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8" Sep 08 09:00:42.825688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.825649 2561 scope.go:117] "RemoveContainer" containerID="2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d" Sep 08 09:00:42.835607 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.835567 2561 scope.go:117] "RemoveContainer" containerID="037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90" Sep 08 09:00:42.839788 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.839734 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8"] Sep 08 09:00:42.845673 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.845635 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-8685984685-99fh8"] Sep 08 09:00:42.847479 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.847460 2561 scope.go:117] "RemoveContainer" containerID="18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5" Sep 08 09:00:42.857996 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.857966 2561 scope.go:117] "RemoveContainer" containerID="0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8" Sep 08 09:00:42.866878 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.866832 2561 scope.go:117] "RemoveContainer" containerID="32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a" Sep 08 09:00:42.867342 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:00:42.867319 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a\": container with ID starting with 32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a not found: ID does not exist" containerID="32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a" Sep 08 09:00:42.867435 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.867351 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a"} err="failed to get container status \"32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a\": rpc error: code = NotFound desc = could not find container \"32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a\": container with ID starting with 32972dc498fe611bff84e3a73fcf7e99b1987645da07e315f3a7aa8abfba903a not found: ID does not exist" Sep 08 09:00:42.867435 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.867375 2561 scope.go:117] "RemoveContainer" containerID="2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d" Sep 08 09:00:42.867688 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:00:42.867671 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d\": container with ID starting with 2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d not found: ID does not exist" containerID="2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d" Sep 08 09:00:42.867734 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.867694 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d"} err="failed to get container status \"2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d\": rpc error: code = NotFound desc = could not find container \"2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d\": container with ID starting with 2b6ae7f34defcdf63a2d1b136436e4692e43deb09955f5e08f90facd4e1a1d4d not found: ID does not exist" Sep 08 09:00:42.867734 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.867709 2561 scope.go:117] "RemoveContainer" containerID="037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90" Sep 08 09:00:42.868108 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:00:42.868088 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90\": container with ID starting with 037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90 not found: ID does not exist" containerID="037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90" Sep 08 09:00:42.868182 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.868113 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90"} err="failed to get container status \"037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90\": rpc error: code = NotFound desc = could not find container \"037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90\": container with ID starting with 037e20eb6a4c446220e8abb65c6e916c2b56bb79e8f0ecc7bb49e3f9eaa68d90 not found: ID does not exist" Sep 08 09:00:42.868182 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.868129 2561 scope.go:117] "RemoveContainer" containerID="18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5" Sep 08 09:00:42.868402 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:00:42.868382 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5\": container with ID starting with 18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5 not found: ID does not exist" containerID="18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5" Sep 08 09:00:42.868452 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.868408 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5"} err="failed to get container status \"18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5\": rpc error: code = NotFound desc = could not find container \"18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5\": container with ID starting with 18e1b35f4f4c0101011a70e00ff49eb3f43afc2efe7befd6bf7d2c725f7ffcd5 not found: ID does not exist" Sep 08 09:00:42.868452 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.868422 2561 scope.go:117] "RemoveContainer" containerID="0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8" Sep 08 09:00:42.868693 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:00:42.868675 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8\": container with ID starting with 0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8 not found: ID does not exist" containerID="0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8" Sep 08 09:00:42.868738 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.868697 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8"} err="failed to get container status \"0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8\": rpc error: code = NotFound desc = could not find container \"0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8\": container with ID starting with 0c66162c3065866248b3026d07e38955497e35d4a0387a42ce06e7292b87d1d8 not found: ID does not exist" Sep 08 09:00:42.954513 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:42.954469 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 09:00:43.058790 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.058727 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-feast-data\") pod \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " Sep 08 09:00:43.058790 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.058795 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-offline-tls\") pod \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " Sep 08 09:00:43.059001 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.058821 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n9x9\" (UniqueName: \"kubernetes.io/projected/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-kube-api-access-8n9x9\") pod \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " Sep 08 09:00:43.059001 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.058946 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-ui-tls\") pod \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " Sep 08 09:00:43.059087 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.059038 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-online-tls\") pod \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " Sep 08 09:00:43.059140 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.059093 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-registry-tls\") pod \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\" (UID: \"ae68d5d6-7a3b-47ca-81da-98ec43b09a11\") " Sep 08 09:00:43.059382 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.059353 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-feast-data" (OuterVolumeSpecName: "feast-data") pod "ae68d5d6-7a3b-47ca-81da-98ec43b09a11" (UID: "ae68d5d6-7a3b-47ca-81da-98ec43b09a11"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:00:43.061251 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.061215 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae68d5d6-7a3b-47ca-81da-98ec43b09a11" (UID: "ae68d5d6-7a3b-47ca-81da-98ec43b09a11"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:43.061251 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.061237 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-online-tls" (OuterVolumeSpecName: "online-tls") pod "ae68d5d6-7a3b-47ca-81da-98ec43b09a11" (UID: "ae68d5d6-7a3b-47ca-81da-98ec43b09a11"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:43.061429 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.061405 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ae68d5d6-7a3b-47ca-81da-98ec43b09a11" (UID: "ae68d5d6-7a3b-47ca-81da-98ec43b09a11"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:43.061429 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.061416 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ae68d5d6-7a3b-47ca-81da-98ec43b09a11" (UID: "ae68d5d6-7a3b-47ca-81da-98ec43b09a11"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:00:43.061555 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.061478 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-kube-api-access-8n9x9" (OuterVolumeSpecName: "kube-api-access-8n9x9") pod "ae68d5d6-7a3b-47ca-81da-98ec43b09a11" (UID: "ae68d5d6-7a3b-47ca-81da-98ec43b09a11"). InnerVolumeSpecName "kube-api-access-8n9x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:00:43.160272 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.160171 2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-ui-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:43.160272 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.160207 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-online-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:43.160272 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.160217 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:43.160272 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.160226 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-feast-data\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:43.160272 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.160235 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-offline-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:43.160272 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.160243 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n9x9\" (UniqueName: \"kubernetes.io/projected/ae68d5d6-7a3b-47ca-81da-98ec43b09a11-kube-api-access-8n9x9\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:00:43.822830 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.822786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" event={"ID":"ae68d5d6-7a3b-47ca-81da-98ec43b09a11","Type":"ContainerDied","Data":"26c9938eff80bb86c3acdbafbccffcf83882b275f3545cbedebfc198b8eebda8"} Sep 08 09:00:43.823270 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.822859 2561 scope.go:117] "RemoveContainer" containerID="5ae0110e60a55cbdeb6147171fc12a43f1bb43fc562bc898156861045fd6e73b" Sep 08 09:00:43.823270 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.822807 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp" Sep 08 09:00:43.832906 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.832870 2561 scope.go:117] "RemoveContainer" containerID="fe4eb04fdb4048ddd95f17f52704332ee93134b61fb1221eb8641af2eab72345" Sep 08 09:00:43.848396 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.848362 2561 scope.go:117] "RemoveContainer" containerID="d9cc10631bb8d72cadd69a514a6a6bd5efb6244b0bf1a2e12e7eadbc8a15f1a1" Sep 08 09:00:43.849022 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.848976 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp"] Sep 08 09:00:43.854890 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.854858 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7bc655655f-4qbcp"] Sep 08 09:00:43.858793 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.858734 2561 scope.go:117] "RemoveContainer" containerID="09d959a6c6feb1dfba47d1003e137c04482581eedef1135e47d618a3b87e9eff" Sep 08 09:00:43.868608 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.868584 2561 scope.go:117] "RemoveContainer" containerID="e604dba1c39fbe2da9191f8fac768c526c14c615cd148c7163abb104287d6f58" Sep 08 09:00:43.877648 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:43.877622 2561 scope.go:117] "RemoveContainer" containerID="b09dbc69b3dd9582c6946f36d20ec79d320a156952e1da0d8c02e5ee4f81757b" Sep 08 09:00:44.212712 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:44.212618 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" path="/var/lib/kubelet/pods/a709ec36-b71f-4013-b81a-7bd22067e9fa/volumes" Sep 08 09:00:44.213210 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:44.213194 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" path="/var/lib/kubelet/pods/ae68d5d6-7a3b-47ca-81da-98ec43b09a11/volumes" Sep 08 09:00:55.020504 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.020422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:00:55.231155 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231118 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-8m5zf"] Sep 08 09:00:55.231427 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231415 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="feast-init" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231430 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="feast-init" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231439 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="feast-apply" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231446 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="feast-apply" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231455 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231460 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231467 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231473 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231479 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="feast-apply" Sep 08 09:00:55.231480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231484 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="feast-apply" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231489 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231495 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231502 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231508 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231516 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231521 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231529 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="feast-init" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231534 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="feast-init" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231542 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231547 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231553 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231558 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231605 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="online" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231612 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="online" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231617 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="ui" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231623 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="offline" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231628 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="registry" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231635 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a709ec36-b71f-4013-b81a-7bd22067e9fa" containerName="ui" Sep 08 09:00:55.231791 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.231641 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae68d5d6-7a3b-47ca-81da-98ec43b09a11" containerName="offline" Sep 08 09:00:55.236511 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.236487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.238988 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.238960 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 08 09:00:55.239146 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.239078 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 09:00:55.239932 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.239911 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-k5xzv\"" Sep 08 09:00:55.240096 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.240001 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 09:00:55.243154 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.243121 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8m5zf"] Sep 08 09:00:55.301512 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.301409 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:00:55.362690 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.362652 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:00:55.367849 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.367802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwxr\" (UniqueName: \"kubernetes.io/projected/54217008-1e73-491c-9527-74bc447ac0df-kube-api-access-9rwxr\") pod \"postgres-864846d4f5-8m5zf\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.368004 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.367863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/54217008-1e73-491c-9527-74bc447ac0df-postgresdata\") pod \"postgres-864846d4f5-8m5zf\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.468788 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.468712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwxr\" (UniqueName: \"kubernetes.io/projected/54217008-1e73-491c-9527-74bc447ac0df-kube-api-access-9rwxr\") pod \"postgres-864846d4f5-8m5zf\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.468788 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.468784 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/54217008-1e73-491c-9527-74bc447ac0df-postgresdata\") pod \"postgres-864846d4f5-8m5zf\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.469145 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.469128 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/54217008-1e73-491c-9527-74bc447ac0df-postgresdata\") pod \"postgres-864846d4f5-8m5zf\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.477275 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.477234 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwxr\" (UniqueName: \"kubernetes.io/projected/54217008-1e73-491c-9527-74bc447ac0df-kube-api-access-9rwxr\") pod \"postgres-864846d4f5-8m5zf\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.559071 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.558971 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:00:55.835184 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.835099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8m5zf"] Sep 08 09:00:55.838852 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:00:55.838813 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54217008_1e73_491c_9527_74bc447ac0df.slice/crio-3e46eac978e07f7c39b8fadb59b98882297da643ca5e50ca9a845ac5868ec3d3 WatchSource:0}: Error finding container 3e46eac978e07f7c39b8fadb59b98882297da643ca5e50ca9a845ac5868ec3d3: Status 404 returned error can't find the container with id 3e46eac978e07f7c39b8fadb59b98882297da643ca5e50ca9a845ac5868ec3d3 Sep 08 09:00:55.840659 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.840640 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 09:00:55.872340 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:00:55.872301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8m5zf" event={"ID":"54217008-1e73-491c-9527-74bc447ac0df","Type":"ContainerStarted","Data":"3e46eac978e07f7c39b8fadb59b98882297da643ca5e50ca9a845ac5868ec3d3"} Sep 08 09:01:01.901611 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:01.901568 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8m5zf" event={"ID":"54217008-1e73-491c-9527-74bc447ac0df","Type":"ContainerStarted","Data":"90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299"} Sep 08 09:01:01.916990 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:01.916932 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-8m5zf" podStartSLOduration=1.621466629 podStartE2EDuration="6.916915029s" totalImagesPullingTime="5.2954484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:01:01.916576757 +0000 UTC m=+806.234032972" watchObservedRunningTime="2026-09-08 09:01:01.916915029 +0000 UTC m=+806.234371244" Sep 08 09:01:05.950899 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:05.950856 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:01:06.056184 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.056135 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:01:06.072843 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.072808 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw"] Sep 08 09:01:06.079963 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.079918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.083127 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.082820 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 08 09:01:06.083127 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.082820 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-mvvnq\"" Sep 08 09:01:06.083127 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.082818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 08 09:01:06.083127 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.083075 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 08 09:01:06.083127 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.083084 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 08 09:01:06.090978 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.090949 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw"] Sep 08 09:01:06.129777 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.129708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:01:06.195425 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.195382 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:01:06.265797 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.265720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-online-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.265797 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.265799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-registry-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.266005 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.265832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eda09d-2f48-4547-82a2-2fbecba42e86-feast-data\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.266005 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.265853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwwt\" (UniqueName: \"kubernetes.io/projected/f5eda09d-2f48-4547-82a2-2fbecba42e86-kube-api-access-2pwwt\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.266005 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.265879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-offline-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.366920 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.366878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-offline-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.367087 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.366945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-online-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.367087 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.366976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-registry-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.367087 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.367005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eda09d-2f48-4547-82a2-2fbecba42e86-feast-data\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.367087 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.367031 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwwt\" (UniqueName: \"kubernetes.io/projected/f5eda09d-2f48-4547-82a2-2fbecba42e86-kube-api-access-2pwwt\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.367456 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.367436 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eda09d-2f48-4547-82a2-2fbecba42e86-feast-data\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.369523 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.369494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-online-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.369642 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.369570 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-registry-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.369642 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.369624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-offline-tls\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.378676 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.378640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwwt\" (UniqueName: \"kubernetes.io/projected/f5eda09d-2f48-4547-82a2-2fbecba42e86-kube-api-access-2pwwt\") pod \"feast-credit-scoring-7f5b8798b8-mxkxw\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.391607 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.391573 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:06.398786 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.398732 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:01:06.675432 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.675347 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw"] Sep 08 09:01:06.678992 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:01:06.678961 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5eda09d_2f48_4547_82a2_2fbecba42e86.slice/crio-d1f112269ade1619905902c433e284ee56fc873158d64fd658c6dac7f177f787 WatchSource:0}: Error finding container d1f112269ade1619905902c433e284ee56fc873158d64fd658c6dac7f177f787: Status 404 returned error can't find the container with id d1f112269ade1619905902c433e284ee56fc873158d64fd658c6dac7f177f787 Sep 08 09:01:06.925244 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.925207 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerStarted","Data":"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006"} Sep 08 09:01:06.925414 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:06.925262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerStarted","Data":"d1f112269ade1619905902c433e284ee56fc873158d64fd658c6dac7f177f787"} Sep 08 09:01:07.931091 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:07.931055 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerID="24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006" exitCode=0 Sep 08 09:01:07.931505 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:07.931146 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerDied","Data":"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006"} Sep 08 09:01:08.936785 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:08.936722 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerStarted","Data":"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1"} Sep 08 09:01:12.826423 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:12.826378 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:01:15.971851 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:15.971738 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerID="8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1" exitCode=0 Sep 08 09:01:15.971851 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:15.971816 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerDied","Data":"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1"} Sep 08 09:01:16.980886 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:16.980833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerStarted","Data":"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa"} Sep 08 09:01:16.981289 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:16.980960 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerStarted","Data":"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf"} Sep 08 09:01:16.981289 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:16.980993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerStarted","Data":"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65"} Sep 08 09:01:17.007357 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:17.007284 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podStartSLOduration=11.007257155 podStartE2EDuration="11.007257155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:01:17.004220726 +0000 UTC m=+821.321676969" watchObservedRunningTime="2026-09-08 09:01:17.007257155 +0000 UTC m=+821.324713379" Sep 08 09:01:18.392143 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:18.392101 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:18.392728 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:18.392185 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:18.392728 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:18.392210 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:18.393911 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:18.393874 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 08 09:01:18.394061 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:18.393930 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 09:01:18.394061 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:18.393872 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Sep 08 09:01:21.392579 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:21.392526 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 08 09:01:21.392579 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:21.392557 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Sep 08 09:01:21.392579 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:21.392573 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 09:01:24.392353 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:24.392302 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 08 09:01:24.393004 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:24.392352 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 09:01:24.393202 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:24.392370 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused" Sep 08 09:01:26.392644 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:26.392593 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:26.393180 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:26.392707 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:26.393180 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:26.392800 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:27.392346 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:27.392299 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 08 09:01:27.393548 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:27.393512 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:27.399615 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:27.399576 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:28.040946 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:28.040909 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:28.044164 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:28.044041 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:30.392364 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:30.392311 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused" Sep 08 09:01:33.393002 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:33.392971 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:33.393805 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:33.393785 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:01:33.608412 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:01:33.608374 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:02:38.477320 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:38.477274 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:02:43.458878 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.458835 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw"] Sep 08 09:02:43.461474 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.459109 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" containerID="cri-o://7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65" gracePeriod=30 Sep 08 09:02:43.461474 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.459162 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" containerID="cri-o://7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa" gracePeriod=30 Sep 08 09:02:43.461474 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.459186 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" containerID="cri-o://199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf" gracePeriod=30 Sep 08 09:02:43.483940 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.483904 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8m5zf"] Sep 08 09:02:43.484124 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.484094 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-8m5zf" podUID="54217008-1e73-491c-9527-74bc447ac0df" containerName="postgres" containerID="cri-o://90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299" gracePeriod=30 Sep 08 09:02:43.563668 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.563627 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:02:43.730829 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.730802 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:02:43.820907 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.820877 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/54217008-1e73-491c-9527-74bc447ac0df-postgresdata\") pod \"54217008-1e73-491c-9527-74bc447ac0df\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " Sep 08 09:02:43.821084 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.820946 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwxr\" (UniqueName: \"kubernetes.io/projected/54217008-1e73-491c-9527-74bc447ac0df-kube-api-access-9rwxr\") pod \"54217008-1e73-491c-9527-74bc447ac0df\" (UID: \"54217008-1e73-491c-9527-74bc447ac0df\") " Sep 08 09:02:43.823130 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.823088 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54217008-1e73-491c-9527-74bc447ac0df-kube-api-access-9rwxr" (OuterVolumeSpecName: "kube-api-access-9rwxr") pod "54217008-1e73-491c-9527-74bc447ac0df" (UID: "54217008-1e73-491c-9527-74bc447ac0df"). InnerVolumeSpecName "kube-api-access-9rwxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:02:43.852846 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.852785 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54217008-1e73-491c-9527-74bc447ac0df-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "54217008-1e73-491c-9527-74bc447ac0df" (UID: "54217008-1e73-491c-9527-74bc447ac0df"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:02:43.922676 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.922628 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwxr\" (UniqueName: \"kubernetes.io/projected/54217008-1e73-491c-9527-74bc447ac0df-kube-api-access-9rwxr\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:02:43.922676 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:43.922676 2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/54217008-1e73-491c-9527-74bc447ac0df-postgresdata\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:02:44.376273 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.376212 2561 generic.go:356] "Generic (PLEG): container finished" podID="54217008-1e73-491c-9527-74bc447ac0df" containerID="90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299" exitCode=0 Sep 08 09:02:44.376273 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.376277 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-8m5zf" Sep 08 09:02:44.376605 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.376301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8m5zf" event={"ID":"54217008-1e73-491c-9527-74bc447ac0df","Type":"ContainerDied","Data":"90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299"} Sep 08 09:02:44.376605 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.376362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-8m5zf" event={"ID":"54217008-1e73-491c-9527-74bc447ac0df","Type":"ContainerDied","Data":"3e46eac978e07f7c39b8fadb59b98882297da643ca5e50ca9a845ac5868ec3d3"} Sep 08 09:02:44.376605 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.376387 2561 scope.go:117] "RemoveContainer" containerID="90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299" Sep 08 09:02:44.386033 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.386007 2561 scope.go:117] "RemoveContainer" containerID="90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299" Sep 08 09:02:44.386482 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:02:44.386460 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299\": container with ID starting with 90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299 not found: ID does not exist" containerID="90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299" Sep 08 09:02:44.386585 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.386491 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299"} err="failed to get container status \"90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299\": rpc error: code = NotFound desc = could not find container \"90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299\": container with ID starting with 90f2f3dc9494af4e6e171f82e0b7ca37a7c5770b8fd9c5713bcc8aa8e73c1299 not found: ID does not exist" Sep 08 09:02:44.394122 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.394076 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8m5zf"] Sep 08 09:02:44.396553 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:44.396512 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-8m5zf"] Sep 08 09:02:45.385067 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:45.385035 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerID="199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf" exitCode=0 Sep 08 09:02:45.385555 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:45.385112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerDied","Data":"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf"} Sep 08 09:02:46.212564 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:46.212527 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54217008-1e73-491c-9527-74bc447ac0df" path="/var/lib/kubelet/pods/54217008-1e73-491c-9527-74bc447ac0df/volumes" Sep 08 09:02:48.040961 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:48.040911 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 09:02:58.041616 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:02:58.041568 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 09:03:08.041360 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:08.041308 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused" Sep 08 09:03:08.041947 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:08.041477 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:03:14.116296 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.116261 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:03:14.170417 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.170370 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-registry-tls\") pod \"f5eda09d-2f48-4547-82a2-2fbecba42e86\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " Sep 08 09:03:14.170615 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.170467 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-online-tls\") pod \"f5eda09d-2f48-4547-82a2-2fbecba42e86\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " Sep 08 09:03:14.170615 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.170515 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pwwt\" (UniqueName: \"kubernetes.io/projected/f5eda09d-2f48-4547-82a2-2fbecba42e86-kube-api-access-2pwwt\") pod \"f5eda09d-2f48-4547-82a2-2fbecba42e86\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " Sep 08 09:03:14.170615 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.170580 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-offline-tls\") pod \"f5eda09d-2f48-4547-82a2-2fbecba42e86\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " Sep 08 09:03:14.170813 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.170618 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eda09d-2f48-4547-82a2-2fbecba42e86-feast-data\") pod \"f5eda09d-2f48-4547-82a2-2fbecba42e86\" (UID: \"f5eda09d-2f48-4547-82a2-2fbecba42e86\") " Sep 08 09:03:14.172641 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.172604 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f5eda09d-2f48-4547-82a2-2fbecba42e86" (UID: "f5eda09d-2f48-4547-82a2-2fbecba42e86"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:03:14.172785 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.172658 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5eda09d-2f48-4547-82a2-2fbecba42e86-kube-api-access-2pwwt" (OuterVolumeSpecName: "kube-api-access-2pwwt") pod "f5eda09d-2f48-4547-82a2-2fbecba42e86" (UID: "f5eda09d-2f48-4547-82a2-2fbecba42e86"). InnerVolumeSpecName "kube-api-access-2pwwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:03:14.172785 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.172662 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f5eda09d-2f48-4547-82a2-2fbecba42e86" (UID: "f5eda09d-2f48-4547-82a2-2fbecba42e86"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:03:14.172921 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.172906 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-online-tls" (OuterVolumeSpecName: "online-tls") pod "f5eda09d-2f48-4547-82a2-2fbecba42e86" (UID: "f5eda09d-2f48-4547-82a2-2fbecba42e86"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:03:14.179199 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.179169 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5eda09d-2f48-4547-82a2-2fbecba42e86-feast-data" (OuterVolumeSpecName: "feast-data") pod "f5eda09d-2f48-4547-82a2-2fbecba42e86" (UID: "f5eda09d-2f48-4547-82a2-2fbecba42e86"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:03:14.272113 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.272061 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:03:14.272113 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.272107 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-online-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:03:14.272113 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.272121 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pwwt\" (UniqueName: \"kubernetes.io/projected/f5eda09d-2f48-4547-82a2-2fbecba42e86-kube-api-access-2pwwt\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:03:14.272442 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.272136 2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f5eda09d-2f48-4547-82a2-2fbecba42e86-offline-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:03:14.272442 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.272145 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f5eda09d-2f48-4547-82a2-2fbecba42e86-feast-data\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:03:14.513197 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513161 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerID="7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa" exitCode=137 Sep 08 09:03:14.513197 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513191 2561 generic.go:356] "Generic (PLEG): container finished" podID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerID="7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65" exitCode=137 Sep 08 09:03:14.513496 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513225 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" Sep 08 09:03:14.513496 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513227 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerDied","Data":"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa"} Sep 08 09:03:14.513496 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerDied","Data":"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65"} Sep 08 09:03:14.513496 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw" event={"ID":"f5eda09d-2f48-4547-82a2-2fbecba42e86","Type":"ContainerDied","Data":"d1f112269ade1619905902c433e284ee56fc873158d64fd658c6dac7f177f787"} Sep 08 09:03:14.513496 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.513452 2561 scope.go:117] "RemoveContainer" containerID="7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa" Sep 08 09:03:14.523949 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.523839 2561 scope.go:117] "RemoveContainer" containerID="199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf" Sep 08 09:03:14.532422 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.532384 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw"] Sep 08 09:03:14.533786 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.533765 2561 scope.go:117] "RemoveContainer" containerID="7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65" Sep 08 09:03:14.536593 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.536559 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-7f5b8798b8-mxkxw"] Sep 08 09:03:14.543833 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.543807 2561 scope.go:117] "RemoveContainer" containerID="8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1" Sep 08 09:03:14.552491 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.552466 2561 scope.go:117] "RemoveContainer" containerID="24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006" Sep 08 09:03:14.561225 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.561201 2561 scope.go:117] "RemoveContainer" containerID="7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa" Sep 08 09:03:14.561602 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:03:14.561579 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa\": container with ID starting with 7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa not found: ID does not exist" containerID="7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa" Sep 08 09:03:14.561655 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.561614 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa"} err="failed to get container status \"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa\": rpc error: code = NotFound desc = could not find container \"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa\": container with ID starting with 7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa not found: ID does not exist" Sep 08 09:03:14.561655 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.561636 2561 scope.go:117] "RemoveContainer" containerID="199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf" Sep 08 09:03:14.561921 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:03:14.561904 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf\": container with ID starting with 199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf not found: ID does not exist" containerID="199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf" Sep 08 09:03:14.561978 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.561926 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf"} err="failed to get container status \"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf\": rpc error: code = NotFound desc = could not find container \"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf\": container with ID starting with 199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf not found: ID does not exist" Sep 08 09:03:14.561978 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.561941 2561 scope.go:117] "RemoveContainer" containerID="7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65" Sep 08 09:03:14.562236 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:03:14.562218 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65\": container with ID starting with 7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65 not found: ID does not exist" containerID="7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65" Sep 08 09:03:14.562301 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.562246 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65"} err="failed to get container status \"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65\": rpc error: code = NotFound desc = could not find container \"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65\": container with ID starting with 7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65 not found: ID does not exist" Sep 08 09:03:14.562301 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.562271 2561 scope.go:117] "RemoveContainer" containerID="8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1" Sep 08 09:03:14.562522 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:03:14.562506 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1\": container with ID starting with 8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1 not found: ID does not exist" containerID="8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1" Sep 08 09:03:14.562562 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.562527 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1"} err="failed to get container status \"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1\": rpc error: code = NotFound desc = could not find container \"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1\": container with ID starting with 8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1 not found: ID does not exist" Sep 08 09:03:14.562562 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.562541 2561 scope.go:117] "RemoveContainer" containerID="24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006" Sep 08 09:03:14.562791 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:03:14.562776 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006\": container with ID starting with 24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006 not found: ID does not exist" containerID="24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006" Sep 08 09:03:14.562847 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.562793 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006"} err="failed to get container status \"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006\": rpc error: code = NotFound desc = could not find container \"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006\": container with ID starting with 24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006 not found: ID does not exist" Sep 08 09:03:14.562847 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.562806 2561 scope.go:117] "RemoveContainer" containerID="7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa" Sep 08 09:03:14.563051 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563035 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa"} err="failed to get container status \"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa\": rpc error: code = NotFound desc = could not find container \"7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa\": container with ID starting with 7bbe05a98d7560f0b8a3546c08b68abd87edd017eaea50b87820d91b65d3adaa not found: ID does not exist" Sep 08 09:03:14.563099 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563050 2561 scope.go:117] "RemoveContainer" containerID="199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf" Sep 08 09:03:14.563280 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563260 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf"} err="failed to get container status \"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf\": rpc error: code = NotFound desc = could not find container \"199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf\": container with ID starting with 199972ca28f4c85f9a4f89bec471868cd2f5bcd7300a7b07ed7f1f7c26bc40cf not found: ID does not exist" Sep 08 09:03:14.563331 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563280 2561 scope.go:117] "RemoveContainer" containerID="7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65" Sep 08 09:03:14.563492 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563476 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65"} err="failed to get container status \"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65\": rpc error: code = NotFound desc = could not find container \"7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65\": container with ID starting with 7a8173e4031fc179975676be23e2ef799ce7150a557ff1707cae141bec69de65 not found: ID does not exist" Sep 08 09:03:14.563541 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563492 2561 scope.go:117] "RemoveContainer" containerID="8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1" Sep 08 09:03:14.563707 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563688 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1"} err="failed to get container status \"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1\": rpc error: code = NotFound desc = could not find container \"8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1\": container with ID starting with 8531f124ef90c563664f3d8bc541d9945d3f8f5f39a60385b10c9c44d49850c1 not found: ID does not exist" Sep 08 09:03:14.563782 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563707 2561 scope.go:117] "RemoveContainer" containerID="24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006" Sep 08 09:03:14.563940 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:14.563923 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006"} err="failed to get container status \"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006\": rpc error: code = NotFound desc = could not find container \"24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006\": container with ID starting with 24714855577d845d3543bf92c83cc123198cc6cecd2b2191cd9c7117734e8006 not found: ID does not exist" Sep 08 09:03:16.213051 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:16.213017 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" path="/var/lib/kubelet/pods/f5eda09d-2f48-4547-82a2-2fbecba42e86/volumes" Sep 08 09:03:21.613963 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:21.613926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:03:21.698252 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:21.698211 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:03:21.811695 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:21.811651 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:03:21.866843 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:21.866729 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:03:22.149104 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:03:22.149068 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:04:33.484236 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:04:33.484131 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:04:33.590970 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:04:33.590931 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:15.149096 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.149049 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:15.249183 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.249143 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:15.274335 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274285 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fbq6t"] Sep 08 09:05:15.274684 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274666 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274688 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274707 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54217008-1e73-491c-9527-74bc447ac0df" containerName="postgres" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274716 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54217008-1e73-491c-9527-74bc447ac0df" containerName="postgres" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274731 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274755 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274767 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="feast-apply" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274776 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="feast-apply" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274787 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="feast-init" Sep 08 09:05:15.274801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274795 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="feast-init" Sep 08 09:05:15.275234 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274809 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" Sep 08 09:05:15.275234 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274817 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" Sep 08 09:05:15.275234 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274917 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54217008-1e73-491c-9527-74bc447ac0df" containerName="postgres" Sep 08 09:05:15.275234 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274933 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="registry" Sep 08 09:05:15.275234 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274944 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="offline" Sep 08 09:05:15.275234 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.274953 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5eda09d-2f48-4547-82a2-2fbecba42e86" containerName="online" Sep 08 09:05:15.277949 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.277922 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:05:15.280571 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.280542 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-xjlh2\"" Sep 08 09:05:15.280722 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.280627 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 08 09:05:15.281322 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.281300 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 08 09:05:15.303482 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.303438 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fbq6t"] Sep 08 09:05:15.328033 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.327987 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:15.393326 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.393291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4m5z\" (UniqueName: \"kubernetes.io/projected/003ae743-025d-403a-aabc-f23935944b4a-kube-api-access-d4m5z\") pod \"redis-69bbd798b6-fbq6t\" (UID: \"003ae743-025d-403a-aabc-f23935944b4a\") " pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:05:15.494226 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.494111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4m5z\" (UniqueName: \"kubernetes.io/projected/003ae743-025d-403a-aabc-f23935944b4a-kube-api-access-d4m5z\") pod \"redis-69bbd798b6-fbq6t\" (UID: \"003ae743-025d-403a-aabc-f23935944b4a\") " pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:05:15.503056 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.503018 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4m5z\" (UniqueName: \"kubernetes.io/projected/003ae743-025d-403a-aabc-f23935944b4a-kube-api-access-d4m5z\") pod \"redis-69bbd798b6-fbq6t\" (UID: \"003ae743-025d-403a-aabc-f23935944b4a\") " pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:05:15.598377 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.598325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:05:15.873091 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.873050 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fbq6t"] Sep 08 09:05:15.876493 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:05:15.876457 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod003ae743_025d_403a_aabc_f23935944b4a.slice/crio-960e88006ea6d37a3458eb761b12993e74a0370d18c050bc72ca1fa117b6bb4b WatchSource:0}: Error finding container 960e88006ea6d37a3458eb761b12993e74a0370d18c050bc72ca1fa117b6bb4b: Status 404 returned error can't find the container with id 960e88006ea6d37a3458eb761b12993e74a0370d18c050bc72ca1fa117b6bb4b Sep 08 09:05:15.998639 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:15.998588 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" event={"ID":"003ae743-025d-403a-aabc-f23935944b4a","Type":"ContainerStarted","Data":"960e88006ea6d37a3458eb761b12993e74a0370d18c050bc72ca1fa117b6bb4b"} Sep 08 09:05:18.009954 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:18.009913 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" event={"ID":"003ae743-025d-403a-aabc-f23935944b4a","Type":"ContainerStarted","Data":"ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906"} Sep 08 09:05:18.029790 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:18.029610 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" podStartSLOduration=1.659968589 podStartE2EDuration="3.029587214s" totalImagesPullingTime="1.369618625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:05:18.029137543 +0000 UTC m=+1062.346593761" watchObservedRunningTime="2026-09-08 09:05:18.029587214 +0000 UTC m=+1062.347043433" Sep 08 09:05:20.703892 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.703849 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-hfb48"] Sep 08 09:05:20.707803 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.707766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:20.710812 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.710726 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 08 09:05:20.719019 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.718983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-hfb48"] Sep 08 09:05:20.754199 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.754162 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:20.841832 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.841785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lln69\" (UniqueName: \"kubernetes.io/projected/c57c6745-b387-406e-b609-5d46dbcd607b-kube-api-access-lln69\") pod \"postgres-864846d4f5-hfb48\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:20.842039 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.841911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c57c6745-b387-406e-b609-5d46dbcd607b-postgresdata\") pod \"postgres-864846d4f5-hfb48\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:20.943286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.943235 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lln69\" (UniqueName: \"kubernetes.io/projected/c57c6745-b387-406e-b609-5d46dbcd607b-kube-api-access-lln69\") pod \"postgres-864846d4f5-hfb48\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:20.943473 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.943332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c57c6745-b387-406e-b609-5d46dbcd607b-postgresdata\") pod \"postgres-864846d4f5-hfb48\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:20.943678 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.943662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c57c6745-b387-406e-b609-5d46dbcd607b-postgresdata\") pod \"postgres-864846d4f5-hfb48\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:20.952701 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:20.952674 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lln69\" (UniqueName: \"kubernetes.io/projected/c57c6745-b387-406e-b609-5d46dbcd607b-kube-api-access-lln69\") pod \"postgres-864846d4f5-hfb48\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:21.018897 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:21.018872 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:05:21.294649 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:21.294547 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-hfb48"] Sep 08 09:05:21.298983 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:05:21.298948 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc57c6745_b387_406e_b609_5d46dbcd607b.slice/crio-51f3bf2ad9dab30abe35bce512485665d7b0c5b5b677ed1cb286216d2c247417 WatchSource:0}: Error finding container 51f3bf2ad9dab30abe35bce512485665d7b0c5b5b677ed1cb286216d2c247417: Status 404 returned error can't find the container with id 51f3bf2ad9dab30abe35bce512485665d7b0c5b5b677ed1cb286216d2c247417 Sep 08 09:05:22.031098 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:22.031058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" event={"ID":"c57c6745-b387-406e-b609-5d46dbcd607b","Type":"ContainerStarted","Data":"a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c"} Sep 08 09:05:22.031497 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:22.031108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" event={"ID":"c57c6745-b387-406e-b609-5d46dbcd607b","Type":"ContainerStarted","Data":"51f3bf2ad9dab30abe35bce512485665d7b0c5b5b677ed1cb286216d2c247417"} Sep 08 09:05:22.049113 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:22.049044 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" podStartSLOduration=2.04902341 podStartE2EDuration="2.04902341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:05:22.047918632 +0000 UTC m=+1066.365374851" watchObservedRunningTime="2026-09-08 09:05:22.04902341 +0000 UTC m=+1066.366479629" Sep 08 09:05:26.165812 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.165759 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:26.247705 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.247662 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc"] Sep 08 09:05:26.254715 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.254685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.257685 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.257652 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 08 09:05:26.257685 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.257678 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 08 09:05:26.257942 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.257678 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 08 09:05:26.258219 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.258196 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-s954b\"" Sep 08 09:05:26.263595 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.263566 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc"] Sep 08 09:05:26.389273 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.389227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.389273 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.389279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-online-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.389497 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.389307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/04214beb-f490-44e8-bfb9-ab7bd1707762-feast-data\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.389497 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.389386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m6ts\" (UniqueName: \"kubernetes.io/projected/04214beb-f490-44e8-bfb9-ab7bd1707762-kube-api-access-4m6ts\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.490865 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.490739 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m6ts\" (UniqueName: \"kubernetes.io/projected/04214beb-f490-44e8-bfb9-ab7bd1707762-kube-api-access-4m6ts\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.490865 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.490856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.491112 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.490884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-online-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.491112 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.490906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/04214beb-f490-44e8-bfb9-ab7bd1707762-feast-data\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.491112 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:05:26.491001 2561 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Sep 08 09:05:26.491112 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:05:26.491070 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls podName:04214beb-f490-44e8-bfb9-ab7bd1707762 nodeName:}" failed. No retries permitted until 2026-09-08 09:05:26.991051506 +0000 UTC m=+1071.308507721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls") pod "feast-credit-scoring-9fb8c97d9-6dhhc" (UID: "04214beb-f490-44e8-bfb9-ab7bd1707762") : secret "feast-credit-scoring-registry-tls" not found Sep 08 09:05:26.491419 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.491395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/04214beb-f490-44e8-bfb9-ab7bd1707762-feast-data\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.493534 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.493511 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-online-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.501605 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.501562 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m6ts\" (UniqueName: \"kubernetes.io/projected/04214beb-f490-44e8-bfb9-ab7bd1707762-kube-api-access-4m6ts\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.995130 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.995078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:26.998008 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:26.997962 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls\") pod \"feast-credit-scoring-9fb8c97d9-6dhhc\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:27.166222 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:27.166178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:27.448801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:27.448769 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc"] Sep 08 09:05:27.450833 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:05:27.450793 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04214beb_f490_44e8_bfb9_ab7bd1707762.slice/crio-ba06444e20c36c838fe330359bb1b4bddfe838281a6b6cd84d691161cfd1a8f9 WatchSource:0}: Error finding container ba06444e20c36c838fe330359bb1b4bddfe838281a6b6cd84d691161cfd1a8f9: Status 404 returned error can't find the container with id ba06444e20c36c838fe330359bb1b4bddfe838281a6b6cd84d691161cfd1a8f9 Sep 08 09:05:28.058357 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:28.058314 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerStarted","Data":"a26e6dfb7f414711d977dfea3dc1c2d3622dcead9140303600c35f7cf2045259"} Sep 08 09:05:28.058551 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:28.058371 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerStarted","Data":"ba06444e20c36c838fe330359bb1b4bddfe838281a6b6cd84d691161cfd1a8f9"} Sep 08 09:05:28.364801 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:28.364678 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:30.067946 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:30.067907 2561 generic.go:356] "Generic (PLEG): container finished" podID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerID="a26e6dfb7f414711d977dfea3dc1c2d3622dcead9140303600c35f7cf2045259" exitCode=0 Sep 08 09:05:30.068352 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:30.067980 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerDied","Data":"a26e6dfb7f414711d977dfea3dc1c2d3622dcead9140303600c35f7cf2045259"} Sep 08 09:05:31.074372 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:31.074326 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerStarted","Data":"effb486dbcc05c589b810c979117e53fd34da8ccf85e0080f2d664949058d829"} Sep 08 09:05:39.113673 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:39.113623 2561 generic.go:356] "Generic (PLEG): container finished" podID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerID="effb486dbcc05c589b810c979117e53fd34da8ccf85e0080f2d664949058d829" exitCode=0 Sep 08 09:05:39.114248 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:39.113708 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerDied","Data":"effb486dbcc05c589b810c979117e53fd34da8ccf85e0080f2d664949058d829"} Sep 08 09:05:39.118805 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:39.118772 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 08 09:05:40.121525 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:40.121482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerStarted","Data":"fdcc64e97845e1fbb2d37e66fe6ebcd79687f259e0a1fe6a07b8c413243dec3a"} Sep 08 09:05:40.121966 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:40.121561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerStarted","Data":"786e09de0c187897facd42e4bef717e24c77b0ed479cefe1a1bc04b407872648"} Sep 08 09:05:40.145764 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:40.145674 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podStartSLOduration=14.145654296 podStartE2EDuration="14.145654296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:05:40.144258798 +0000 UTC m=+1084.461715040" watchObservedRunningTime="2026-09-08 09:05:40.145654296 +0000 UTC m=+1084.463110513" Sep 08 09:05:42.166544 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:42.166500 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:42.166946 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:42.166621 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:42.168320 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:42.168284 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 09:05:42.168469 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:42.168336 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 09:05:45.167156 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:45.167090 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 09:05:45.167720 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:45.167105 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 09:05:47.166787 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:47.166716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:47.167193 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:47.166824 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:48.167150 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:48.167093 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 09:05:48.173942 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:48.173894 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:48.177510 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:48.177472 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:51.167779 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:51.167701 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused" Sep 08 09:05:54.168021 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:54.167982 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:54.168872 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:54.168847 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:05:54.444507 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:54.444408 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:57.063358 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.063302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:57.142075 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.142032 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:57.145620 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.145572 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n"] Sep 08 09:05:57.150560 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.150525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.153206 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.153162 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 08 09:05:57.153393 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.153206 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 08 09:05:57.153393 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.153323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-bnshz\"" Sep 08 09:05:57.153503 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.153447 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 08 09:05:57.160386 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.160354 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n"] Sep 08 09:05:57.272472 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.272422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1377d21f-3758-4cce-9a6f-c84d306a3510-feast-data\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.272684 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.272481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc49t\" (UniqueName: \"kubernetes.io/projected/1377d21f-3758-4cce-9a6f-c84d306a3510-kube-api-access-dc49t\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.272684 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.272530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.272833 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.272675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-online-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.359818 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.359696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:57.373709 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.373675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1377d21f-3758-4cce-9a6f-c84d306a3510-feast-data\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.373709 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.373716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc49t\" (UniqueName: \"kubernetes.io/projected/1377d21f-3758-4cce-9a6f-c84d306a3510-kube-api-access-dc49t\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.373955 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.373775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.373955 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.373816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-online-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.373955 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:05:57.373924 2561 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Sep 08 09:05:57.374066 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:05:57.374038 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls podName:1377d21f-3758-4cce-9a6f-c84d306a3510 nodeName:}" failed. No retries permitted until 2026-09-08 09:05:57.874014342 +0000 UTC m=+1102.191470555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls") pod "feast-driver-ranking-5cc4d6479d-v8d2n" (UID: "1377d21f-3758-4cce-9a6f-c84d306a3510") : secret "feast-driver-ranking-registry-tls" not found Sep 08 09:05:57.374211 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.374188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1377d21f-3758-4cce-9a6f-c84d306a3510-feast-data\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.376689 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.376649 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-online-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.385363 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.385324 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc49t\" (UniqueName: \"kubernetes.io/projected/1377d21f-3758-4cce-9a6f-c84d306a3510-kube-api-access-dc49t\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.490206 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.490173 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:05:57.880097 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.880053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:57.882693 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:57.882655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls\") pod \"feast-driver-ranking-5cc4d6479d-v8d2n\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:58.064033 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:58.063987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:05:58.343183 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:58.343016 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n"] Sep 08 09:05:58.345921 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:05:58.345890 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1377d21f_3758_4cce_9a6f_c84d306a3510.slice/crio-6824880f5c1ebc45bbd3edd3b2dd468cdf19bcd7840f47f277f9de48ea5b8c6d WatchSource:0}: Error finding container 6824880f5c1ebc45bbd3edd3b2dd468cdf19bcd7840f47f277f9de48ea5b8c6d: Status 404 returned error can't find the container with id 6824880f5c1ebc45bbd3edd3b2dd468cdf19bcd7840f47f277f9de48ea5b8c6d Sep 08 09:05:59.223061 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:59.223008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerStarted","Data":"9233163a91d88d24d1b3546435eb3f9984c63fad9e3886ce5edec3c870b680af"} Sep 08 09:05:59.223520 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:05:59.223117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerStarted","Data":"6824880f5c1ebc45bbd3edd3b2dd468cdf19bcd7840f47f277f9de48ea5b8c6d"} Sep 08 09:06:04.248492 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:04.248398 2561 generic.go:356] "Generic (PLEG): container finished" podID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerID="9233163a91d88d24d1b3546435eb3f9984c63fad9e3886ce5edec3c870b680af" exitCode=0 Sep 08 09:06:04.248492 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:04.248470 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerDied","Data":"9233163a91d88d24d1b3546435eb3f9984c63fad9e3886ce5edec3c870b680af"} Sep 08 09:06:05.263411 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:05.263369 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerStarted","Data":"729ed0a9c7a7f4693caa4cbdea6827a8fa8f55875a810e6a51dc0c70882198ab"} Sep 08 09:06:12.297440 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:12.297401 2561 generic.go:356] "Generic (PLEG): container finished" podID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerID="729ed0a9c7a7f4693caa4cbdea6827a8fa8f55875a810e6a51dc0c70882198ab" exitCode=0 Sep 08 09:06:12.297970 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:12.297475 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerDied","Data":"729ed0a9c7a7f4693caa4cbdea6827a8fa8f55875a810e6a51dc0c70882198ab"} Sep 08 09:06:13.305352 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:13.305306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerStarted","Data":"7e5c7536108487c2d0e649652e91fa379591da81bd13943de685fc11c59f25ff"} Sep 08 09:06:13.305877 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:13.305377 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerStarted","Data":"74a48e35c6fb019bf37f089529e0ac58ef5df503baead418423706fdf2244621"} Sep 08 09:06:13.333197 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:13.333127 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podStartSLOduration=16.333096772 podStartE2EDuration="16.333096772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:06:13.331024927 +0000 UTC m=+1117.648481156" watchObservedRunningTime="2026-09-08 09:06:13.333096772 +0000 UTC m=+1117.650552990" Sep 08 09:06:16.064442 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:16.064391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:16.064951 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:16.064490 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:16.066585 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:16.066535 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused" Sep 08 09:06:16.066789 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:16.066581 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 09:06:18.065142 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:18.065093 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:18.065550 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:18.065183 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:19.065055 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:19.065010 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused" Sep 08 09:06:19.065371 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:19.065091 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 09:06:22.064609 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:22.064542 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused" Sep 08 09:06:22.071382 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:22.071336 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:22.075416 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:22.075385 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:25.064840 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:25.064792 2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused" Sep 08 09:06:28.065578 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:28.065539 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:06:28.066375 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:06:28.066352 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:07:17.634842 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:17.634800 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:52.762877 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:52.762837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:54.595653 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:54.595595 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:54.963423 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:54.963333 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4"] Sep 08 09:07:54.963581 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:54.963543 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" podUID="e3aa172a-bca5-4402-b4f3-dedb4dbeb128" containerName="manager" containerID="cri-o://4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921" gracePeriod=10 Sep 08 09:07:54.973021 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:54.972988 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:55.214319 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.214093 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:55.254536 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.254492 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 09:07:55.258333 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.258293 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc"] Sep 08 09:07:55.258605 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.258577 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" containerID="cri-o://786e09de0c187897facd42e4bef717e24c77b0ed479cefe1a1bc04b407872648" gracePeriod=30 Sep 08 09:07:55.258710 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.258603 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" containerID="cri-o://fdcc64e97845e1fbb2d37e66fe6ebcd79687f259e0a1fe6a07b8c413243dec3a" gracePeriod=30 Sep 08 09:07:55.269913 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.269873 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n"] Sep 08 09:07:55.270200 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.270167 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" containerID="cri-o://74a48e35c6fb019bf37f089529e0ac58ef5df503baead418423706fdf2244621" gracePeriod=30 Sep 08 09:07:55.270291 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.270220 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" containerID="cri-o://7e5c7536108487c2d0e649652e91fa379591da81bd13943de685fc11c59f25ff" gracePeriod=30 Sep 08 09:07:55.398557 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.398514 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhc8b\" (UniqueName: \"kubernetes.io/projected/e3aa172a-bca5-4402-b4f3-dedb4dbeb128-kube-api-access-mhc8b\") pod \"e3aa172a-bca5-4402-b4f3-dedb4dbeb128\" (UID: \"e3aa172a-bca5-4402-b4f3-dedb4dbeb128\") " Sep 08 09:07:55.400778 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.400729 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3aa172a-bca5-4402-b4f3-dedb4dbeb128-kube-api-access-mhc8b" (OuterVolumeSpecName: "kube-api-access-mhc8b") pod "e3aa172a-bca5-4402-b4f3-dedb4dbeb128" (UID: "e3aa172a-bca5-4402-b4f3-dedb4dbeb128"). InnerVolumeSpecName "kube-api-access-mhc8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:07:55.499309 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.499208 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhc8b\" (UniqueName: \"kubernetes.io/projected/e3aa172a-bca5-4402-b4f3-dedb4dbeb128-kube-api-access-mhc8b\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:07:55.779915 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.779877 2561 generic.go:356] "Generic (PLEG): container finished" podID="e3aa172a-bca5-4402-b4f3-dedb4dbeb128" containerID="4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921" exitCode=0 Sep 08 09:07:55.780379 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.779934 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" Sep 08 09:07:55.780379 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.779961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" event={"ID":"e3aa172a-bca5-4402-b4f3-dedb4dbeb128","Type":"ContainerDied","Data":"4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921"} Sep 08 09:07:55.780379 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.780022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4" event={"ID":"e3aa172a-bca5-4402-b4f3-dedb4dbeb128","Type":"ContainerDied","Data":"01d92441a2f5fd51f0bf0aeddeb135424c89eef9edf854a6cf08f7e617ee0fad"} Sep 08 09:07:55.780379 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.780054 2561 scope.go:117] "RemoveContainer" containerID="4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921" Sep 08 09:07:55.789284 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.789256 2561 scope.go:117] "RemoveContainer" containerID="4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921" Sep 08 09:07:55.789681 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:07:55.789656 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921\": container with ID starting with 4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921 not found: ID does not exist" containerID="4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921" Sep 08 09:07:55.789824 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.789691 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921"} err="failed to get container status \"4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921\": rpc error: code = NotFound desc = could not find container \"4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921\": container with ID starting with 4ac2d8332d70bd5b2e9cbcd57461d8723193d5dcbe70b3317a9eb38949af3921 not found: ID does not exist" Sep 08 09:07:55.805903 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.805869 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4"] Sep 08 09:07:55.810269 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.810229 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-8474b64bd-l74v4"] Sep 08 09:07:55.896370 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:55.896332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:56.212702 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:56.212671 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3aa172a-bca5-4402-b4f3-dedb4dbeb128" path="/var/lib/kubelet/pods/e3aa172a-bca5-4402-b4f3-dedb4dbeb128/volumes" Sep 08 09:07:56.786589 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:56.786559 2561 generic.go:356] "Generic (PLEG): container finished" podID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerID="7e5c7536108487c2d0e649652e91fa379591da81bd13943de685fc11c59f25ff" exitCode=0 Sep 08 09:07:56.787008 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:56.786631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerDied","Data":"7e5c7536108487c2d0e649652e91fa379591da81bd13943de685fc11c59f25ff"} Sep 08 09:07:56.788966 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:56.788942 2561 generic.go:356] "Generic (PLEG): container finished" podID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerID="fdcc64e97845e1fbb2d37e66fe6ebcd79687f259e0a1fe6a07b8c413243dec3a" exitCode=0 Sep 08 09:07:56.789104 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:56.789023 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerDied","Data":"fdcc64e97845e1fbb2d37e66fe6ebcd79687f259e0a1fe6a07b8c413243dec3a"} Sep 08 09:07:57.691421 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.691381 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-hfb48"] Sep 08 09:07:57.691644 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.691616 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" podUID="c57c6745-b387-406e-b609-5d46dbcd607b" containerName="postgres" containerID="cri-o://a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c" gracePeriod=30 Sep 08 09:07:57.702134 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.702078 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fbq6t"] Sep 08 09:07:57.702356 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.702310 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" podUID="003ae743-025d-403a-aabc-f23935944b4a" containerName="redis" containerID="cri-o://ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906" gracePeriod=30 Sep 08 09:07:57.785285 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.785248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:07:57.977029 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.976994 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:07:57.980596 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:57.980566 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:07:58.137162 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.137110 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lln69\" (UniqueName: \"kubernetes.io/projected/c57c6745-b387-406e-b609-5d46dbcd607b-kube-api-access-lln69\") pod \"c57c6745-b387-406e-b609-5d46dbcd607b\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " Sep 08 09:07:58.137162 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.137166 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c57c6745-b387-406e-b609-5d46dbcd607b-postgresdata\") pod \"c57c6745-b387-406e-b609-5d46dbcd607b\" (UID: \"c57c6745-b387-406e-b609-5d46dbcd607b\") " Sep 08 09:07:58.137162 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.137185 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4m5z\" (UniqueName: \"kubernetes.io/projected/003ae743-025d-403a-aabc-f23935944b4a-kube-api-access-d4m5z\") pod \"003ae743-025d-403a-aabc-f23935944b4a\" (UID: \"003ae743-025d-403a-aabc-f23935944b4a\") " Sep 08 09:07:58.139725 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.139668 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/003ae743-025d-403a-aabc-f23935944b4a-kube-api-access-d4m5z" (OuterVolumeSpecName: "kube-api-access-d4m5z") pod "003ae743-025d-403a-aabc-f23935944b4a" (UID: "003ae743-025d-403a-aabc-f23935944b4a"). InnerVolumeSpecName "kube-api-access-d4m5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:07:58.139943 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.139760 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57c6745-b387-406e-b609-5d46dbcd607b-kube-api-access-lln69" (OuterVolumeSpecName: "kube-api-access-lln69") pod "c57c6745-b387-406e-b609-5d46dbcd607b" (UID: "c57c6745-b387-406e-b609-5d46dbcd607b"). InnerVolumeSpecName "kube-api-access-lln69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:07:58.168766 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.168693 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c57c6745-b387-406e-b609-5d46dbcd607b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "c57c6745-b387-406e-b609-5d46dbcd607b" (UID: "c57c6745-b387-406e-b609-5d46dbcd607b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:07:58.174570 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.174527 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 09:07:58.238183 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.238147 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lln69\" (UniqueName: \"kubernetes.io/projected/c57c6745-b387-406e-b609-5d46dbcd607b-kube-api-access-lln69\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:07:58.238183 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.238179 2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c57c6745-b387-406e-b609-5d46dbcd607b-postgresdata\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:07:58.238183 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.238190 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4m5z\" (UniqueName: \"kubernetes.io/projected/003ae743-025d-403a-aabc-f23935944b4a-kube-api-access-d4m5z\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:07:58.800456 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.800415 2561 generic.go:356] "Generic (PLEG): container finished" podID="c57c6745-b387-406e-b609-5d46dbcd607b" containerID="a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c" exitCode=0 Sep 08 09:07:58.800661 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.800461 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" Sep 08 09:07:58.800661 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.800507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" event={"ID":"c57c6745-b387-406e-b609-5d46dbcd607b","Type":"ContainerDied","Data":"a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c"} Sep 08 09:07:58.800661 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.800552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-hfb48" event={"ID":"c57c6745-b387-406e-b609-5d46dbcd607b","Type":"ContainerDied","Data":"51f3bf2ad9dab30abe35bce512485665d7b0c5b5b677ed1cb286216d2c247417"} Sep 08 09:07:58.800661 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.800572 2561 scope.go:117] "RemoveContainer" containerID="a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c" Sep 08 09:07:58.802031 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.801895 2561 generic.go:356] "Generic (PLEG): container finished" podID="003ae743-025d-403a-aabc-f23935944b4a" containerID="ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906" exitCode=0 Sep 08 09:07:58.802031 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.801946 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" Sep 08 09:07:58.802031 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.801969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" event={"ID":"003ae743-025d-403a-aabc-f23935944b4a","Type":"ContainerDied","Data":"ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906"} Sep 08 09:07:58.802031 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.802002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-fbq6t" event={"ID":"003ae743-025d-403a-aabc-f23935944b4a","Type":"ContainerDied","Data":"960e88006ea6d37a3458eb761b12993e74a0370d18c050bc72ca1fa117b6bb4b"} Sep 08 09:07:58.809637 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.809612 2561 scope.go:117] "RemoveContainer" containerID="a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c" Sep 08 09:07:58.810030 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:07:58.810004 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c\": container with ID starting with a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c not found: ID does not exist" containerID="a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c" Sep 08 09:07:58.810135 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.810042 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c"} err="failed to get container status \"a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c\": rpc error: code = NotFound desc = could not find container \"a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c\": container with ID starting with a7a4f7d98c6215cb9f17885009dee544c24d3df3c9b82d4c8bc769a503355a3c not found: ID does not exist" Sep 08 09:07:58.810135 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.810070 2561 scope.go:117] "RemoveContainer" containerID="ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906" Sep 08 09:07:58.817010 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.816966 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-hfb48"] Sep 08 09:07:58.819626 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.819599 2561 scope.go:117] "RemoveContainer" containerID="ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906" Sep 08 09:07:58.819890 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.819869 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-hfb48"] Sep 08 09:07:58.820035 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:07:58.820014 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906\": container with ID starting with ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906 not found: ID does not exist" containerID="ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906" Sep 08 09:07:58.820093 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.820056 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906"} err="failed to get container status \"ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906\": rpc error: code = NotFound desc = could not find container \"ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906\": container with ID starting with ba6e02ca100fd241c263acdb55094c1d4ff4e8135f393c0a1c004d7888581906 not found: ID does not exist" Sep 08 09:07:58.829470 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.829430 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fbq6t"] Sep 08 09:07:58.833061 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:07:58.833026 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-fbq6t"] Sep 08 09:08:00.034692 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:00.034653 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:00.134635 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:00.134594 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:00.212713 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:00.212677 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="003ae743-025d-403a-aabc-f23935944b4a" path="/var/lib/kubelet/pods/003ae743-025d-403a-aabc-f23935944b4a/volumes" Sep 08 09:08:00.213068 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:00.213055 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57c6745-b387-406e-b609-5d46dbcd607b" path="/var/lib/kubelet/pods/c57c6745-b387-406e-b609-5d46dbcd607b/volumes" Sep 08 09:08:02.072985 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:02.072928 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 09:08:05.402700 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:05.402658 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:05.463499 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:05.463468 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:05.837479 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:05.837436 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:08.175217 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:08.175171 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 09:08:12.072354 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:12.072300 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 09:08:18.175086 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:18.175041 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused" Sep 08 09:08:18.175581 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:18.175188 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:08:22.049618 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.049573 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:22.072777 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.072702 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused" Sep 08 09:08:22.072972 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.072923 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:08:22.111312 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.111271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:22.716060 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.716007 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:22.817845 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.817809 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:22.884110 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.884069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:22.944261 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:22.944218 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:23.121339 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:23.121303 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:25.918412 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.918382 2561 generic.go:356] "Generic (PLEG): container finished" podID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerID="786e09de0c187897facd42e4bef717e24c77b0ed479cefe1a1bc04b407872648" exitCode=137 Sep 08 09:08:25.918849 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.918446 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerDied","Data":"786e09de0c187897facd42e4bef717e24c77b0ed479cefe1a1bc04b407872648"} Sep 08 09:08:25.918849 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.918514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" event={"ID":"04214beb-f490-44e8-bfb9-ab7bd1707762","Type":"ContainerDied","Data":"ba06444e20c36c838fe330359bb1b4bddfe838281a6b6cd84d691161cfd1a8f9"} Sep 08 09:08:25.918849 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.918535 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba06444e20c36c838fe330359bb1b4bddfe838281a6b6cd84d691161cfd1a8f9" Sep 08 09:08:25.920808 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.920784 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:08:25.921339 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.921314 2561 generic.go:356] "Generic (PLEG): container finished" podID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerID="74a48e35c6fb019bf37f089529e0ac58ef5df503baead418423706fdf2244621" exitCode=137 Sep 08 09:08:25.921396 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.921352 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerDied","Data":"74a48e35c6fb019bf37f089529e0ac58ef5df503baead418423706fdf2244621"} Sep 08 09:08:25.952572 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.952544 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:08:25.962881 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.962847 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-online-tls\") pod \"1377d21f-3758-4cce-9a6f-c84d306a3510\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " Sep 08 09:08:25.962881 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.962885 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m6ts\" (UniqueName: \"kubernetes.io/projected/04214beb-f490-44e8-bfb9-ab7bd1707762-kube-api-access-4m6ts\") pod \"04214beb-f490-44e8-bfb9-ab7bd1707762\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " Sep 08 09:08:25.963102 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.962904 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc49t\" (UniqueName: \"kubernetes.io/projected/1377d21f-3758-4cce-9a6f-c84d306a3510-kube-api-access-dc49t\") pod \"1377d21f-3758-4cce-9a6f-c84d306a3510\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " Sep 08 09:08:25.963102 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.962919 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-online-tls\") pod \"04214beb-f490-44e8-bfb9-ab7bd1707762\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " Sep 08 09:08:25.963102 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.962936 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/04214beb-f490-44e8-bfb9-ab7bd1707762-feast-data\") pod \"04214beb-f490-44e8-bfb9-ab7bd1707762\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " Sep 08 09:08:25.963102 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.962974 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls\") pod \"04214beb-f490-44e8-bfb9-ab7bd1707762\" (UID: \"04214beb-f490-44e8-bfb9-ab7bd1707762\") " Sep 08 09:08:25.963102 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.963019 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls\") pod \"1377d21f-3758-4cce-9a6f-c84d306a3510\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " Sep 08 09:08:25.965719 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.965675 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1377d21f-3758-4cce-9a6f-c84d306a3510" (UID: "1377d21f-3758-4cce-9a6f-c84d306a3510"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:08:25.965719 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.965695 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-online-tls" (OuterVolumeSpecName: "online-tls") pod "04214beb-f490-44e8-bfb9-ab7bd1707762" (UID: "04214beb-f490-44e8-bfb9-ab7bd1707762"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:08:25.965934 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.965729 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1377d21f-3758-4cce-9a6f-c84d306a3510-kube-api-access-dc49t" (OuterVolumeSpecName: "kube-api-access-dc49t") pod "1377d21f-3758-4cce-9a6f-c84d306a3510" (UID: "1377d21f-3758-4cce-9a6f-c84d306a3510"). InnerVolumeSpecName "kube-api-access-dc49t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:08:25.965934 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.965735 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04214beb-f490-44e8-bfb9-ab7bd1707762-kube-api-access-4m6ts" (OuterVolumeSpecName: "kube-api-access-4m6ts") pod "04214beb-f490-44e8-bfb9-ab7bd1707762" (UID: "04214beb-f490-44e8-bfb9-ab7bd1707762"). InnerVolumeSpecName "kube-api-access-4m6ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:08:25.966436 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.966409 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-online-tls" (OuterVolumeSpecName: "online-tls") pod "1377d21f-3758-4cce-9a6f-c84d306a3510" (UID: "1377d21f-3758-4cce-9a6f-c84d306a3510"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:08:25.966513 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.966458 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "04214beb-f490-44e8-bfb9-ab7bd1707762" (UID: "04214beb-f490-44e8-bfb9-ab7bd1707762"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 09:08:25.972987 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:25.972941 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04214beb-f490-44e8-bfb9-ab7bd1707762-feast-data" (OuterVolumeSpecName: "feast-data") pod "04214beb-f490-44e8-bfb9-ab7bd1707762" (UID: "04214beb-f490-44e8-bfb9-ab7bd1707762"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:08:26.064104 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.063983 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1377d21f-3758-4cce-9a6f-c84d306a3510-feast-data\") pod \"1377d21f-3758-4cce-9a6f-c84d306a3510\" (UID: \"1377d21f-3758-4cce-9a6f-c84d306a3510\") " Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064201 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064220 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1377d21f-3758-4cce-9a6f-c84d306a3510-online-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064232 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m6ts\" (UniqueName: \"kubernetes.io/projected/04214beb-f490-44e8-bfb9-ab7bd1707762-kube-api-access-4m6ts\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064247 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc49t\" (UniqueName: \"kubernetes.io/projected/1377d21f-3758-4cce-9a6f-c84d306a3510-kube-api-access-dc49t\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064260 2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-online-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064271 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/04214beb-f490-44e8-bfb9-ab7bd1707762-feast-data\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064292 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064282 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/04214beb-f490-44e8-bfb9-ab7bd1707762-registry-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.064520 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.064413 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1377d21f-3758-4cce-9a6f-c84d306a3510-feast-data" (OuterVolumeSpecName: "feast-data") pod "1377d21f-3758-4cce-9a6f-c84d306a3510" (UID: "1377d21f-3758-4cce-9a6f-c84d306a3510"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:08:26.165206 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.165172 2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1377d21f-3758-4cce-9a6f-c84d306a3510-feast-data\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:08:26.927850 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.927818 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" Sep 08 09:08:26.927850 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.927852 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc" Sep 08 09:08:26.928520 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.927852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n" event={"ID":"1377d21f-3758-4cce-9a6f-c84d306a3510","Type":"ContainerDied","Data":"6824880f5c1ebc45bbd3edd3b2dd468cdf19bcd7840f47f277f9de48ea5b8c6d"} Sep 08 09:08:26.928520 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.927918 2561 scope.go:117] "RemoveContainer" containerID="7e5c7536108487c2d0e649652e91fa379591da81bd13943de685fc11c59f25ff" Sep 08 09:08:26.939142 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.939092 2561 scope.go:117] "RemoveContainer" containerID="74a48e35c6fb019bf37f089529e0ac58ef5df503baead418423706fdf2244621" Sep 08 09:08:26.949259 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.949218 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc"] Sep 08 09:08:26.953130 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.953095 2561 scope.go:117] "RemoveContainer" containerID="729ed0a9c7a7f4693caa4cbdea6827a8fa8f55875a810e6a51dc0c70882198ab" Sep 08 09:08:26.955571 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.955545 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9fb8c97d9-6dhhc"] Sep 08 09:08:26.962129 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.962106 2561 scope.go:117] "RemoveContainer" containerID="9233163a91d88d24d1b3546435eb3f9984c63fad9e3886ce5edec3c870b680af" Sep 08 09:08:26.966436 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.966402 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n"] Sep 08 09:08:26.972813 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:26.972785 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cc4d6479d-v8d2n"] Sep 08 09:08:28.212595 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:28.212512 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" path="/var/lib/kubelet/pods/04214beb-f490-44e8-bfb9-ab7bd1707762/volumes" Sep 08 09:08:28.213065 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:28.213049 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" path="/var/lib/kubelet/pods/1377d21f-3758-4cce-9a6f-c84d306a3510/volumes" Sep 08 09:08:35.311366 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:35.311332 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:35.370237 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:35.370200 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:35.515759 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:35.515710 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:08:53.203381 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:08:53.203342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:10:03.007931 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:10:03.007680 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:10:03.078274 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:10:03.078233 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:10:03.324975 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:10:03.324867 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:10:03.510976 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:10:03.510939 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:10:03.611173 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:10:03.611067 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:10:03.711877 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:10:03.711823 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:11:27.047213 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:11:27.047172 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:11:28.384916 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:11:28.384876 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:11:28.487460 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:11:28.487415 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:11:28.603673 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:11:28.603638 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:11:38.893661 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:11:38.893616 2561 scope.go:117] "RemoveContainer" containerID="effb486dbcc05c589b810c979117e53fd34da8ccf85e0080f2d664949058d829" Sep 08 09:11:38.902175 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:11:38.902150 2561 scope.go:117] "RemoveContainer" containerID="a26e6dfb7f414711d977dfea3dc1c2d3622dcead9140303600c35f7cf2045259" Sep 08 09:12:38.916031 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:12:38.915997 2561 scope.go:117] "RemoveContainer" containerID="786e09de0c187897facd42e4bef717e24c77b0ed479cefe1a1bc04b407872648" Sep 08 09:12:38.924396 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:12:38.924375 2561 scope.go:117] "RemoveContainer" containerID="fdcc64e97845e1fbb2d37e66fe6ebcd79687f259e0a1fe6a07b8c413243dec3a" Sep 08 09:13:33.843625 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:13:33.843534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:13:34.085288 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:13:34.085242 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:13:38.160158 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:13:38.160111 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:15.813300 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:15.813266 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:15.924339 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:15.924307 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:21.541771 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:21.541709 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:21.607358 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:21.607321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:23.876159 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:23.876109 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:23.937607 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:23.937572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:40.791793 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:40.791686 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:40.892475 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:40.892431 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:44.311425 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:44.311378 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:44.413863 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:44.413795 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:44.512699 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:44.512661 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:44.611296 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:44.611200 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:44.712041 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:44.712005 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:14:44.812247 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:14:44.812191 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:15:56.723551 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:15:56.723511 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:07.773442 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:07.773344 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:07.832697 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:07.832663 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:08.104177 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:08.104087 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:08.203164 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:08.203117 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:08.282224 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:08.282190 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:08.400218 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:08.400118 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:08.594214 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:08.594177 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:16:08.656224 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:16:08.656125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:17:32.331088 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:17:32.330993 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:17:33.860973 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:17:33.860935 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:17:54.539430 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:17:54.539391 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:19:18.920026 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:19:18.919892 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:19:18.996681 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:19:18.996645 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:19:19.071512 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:19:19.071470 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:19:19.206850 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:19:19.206721 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:19:19.264480 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:19:19.264429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:19:24.246576 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:19:24.246532 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:00.870314 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:00.870269 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:00.971730 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:00.971695 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:02.090563 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:02.090522 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:02.190716 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:02.190670 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:07.540065 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:07.540025 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:07.600148 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:07.600112 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:08.699912 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.699879 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w4g52/must-gather-n24jz"] Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700182 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57c6745-b387-406e-b609-5d46dbcd607b" containerName="postgres" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700194 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57c6745-b387-406e-b609-5d46dbcd607b" containerName="postgres" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700202 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="feast-init" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700207 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="feast-init" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700215 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="feast-apply" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700220 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="feast-apply" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700226 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700231 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700241 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700248 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700257 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="feast-apply" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700262 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="feast-apply" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700271 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="003ae743-025d-403a-aabc-f23935944b4a" containerName="redis" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700276 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="003ae743-025d-403a-aabc-f23935944b4a" containerName="redis" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700280 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700285 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" Sep 08 09:20:08.700286 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700292 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700297 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700306 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3aa172a-bca5-4402-b4f3-dedb4dbeb128" containerName="manager" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700311 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3aa172a-bca5-4402-b4f3-dedb4dbeb128" containerName="manager" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700316 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="feast-init" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700321 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="feast-init" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700368 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57c6745-b387-406e-b609-5d46dbcd607b" containerName="postgres" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700376 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="online" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700383 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="online" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700389 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1377d21f-3758-4cce-9a6f-c84d306a3510" containerName="registry" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700396 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="003ae743-025d-403a-aabc-f23935944b4a" containerName="redis" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700401 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3aa172a-bca5-4402-b4f3-dedb4dbeb128" containerName="manager" Sep 08 09:20:08.700817 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.700406 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="04214beb-f490-44e8-bfb9-ab7bd1707762" containerName="registry" Sep 08 09:20:08.703297 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.703280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:08.705696 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.705673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4g52\"/\"kube-root-ca.crt\"" Sep 08 09:20:08.705834 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.705673 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w4g52\"/\"default-dockercfg-fqzlm\"" Sep 08 09:20:08.705834 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.705719 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4g52\"/\"openshift-service-ca.crt\"" Sep 08 09:20:08.710864 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.710839 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4g52/must-gather-n24jz"] Sep 08 09:20:08.867891 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.867840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5aba172f-a5b2-4cf3-adbd-b60f0e825323-must-gather-output\") pod \"must-gather-n24jz\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:08.868085 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.867909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrf7\" (UniqueName: \"kubernetes.io/projected/5aba172f-a5b2-4cf3-adbd-b60f0e825323-kube-api-access-tdrf7\") pod \"must-gather-n24jz\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:08.969227 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.969126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5aba172f-a5b2-4cf3-adbd-b60f0e825323-must-gather-output\") pod \"must-gather-n24jz\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:08.969227 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.969187 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrf7\" (UniqueName: \"kubernetes.io/projected/5aba172f-a5b2-4cf3-adbd-b60f0e825323-kube-api-access-tdrf7\") pod \"must-gather-n24jz\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:08.969506 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.969483 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5aba172f-a5b2-4cf3-adbd-b60f0e825323-must-gather-output\") pod \"must-gather-n24jz\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:08.977903 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:08.977873 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrf7\" (UniqueName: \"kubernetes.io/projected/5aba172f-a5b2-4cf3-adbd-b60f0e825323-kube-api-access-tdrf7\") pod \"must-gather-n24jz\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:09.024848 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:09.024802 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:09.303129 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:09.303099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4g52/must-gather-n24jz"] Sep 08 09:20:09.306017 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:20:09.305990 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5aba172f_a5b2_4cf3_adbd_b60f0e825323.slice/crio-c4407be28d4592858d52b9180ad52ddcb80b7635b72eeba1b4f1dcd18a914d1d WatchSource:0}: Error finding container c4407be28d4592858d52b9180ad52ddcb80b7635b72eeba1b4f1dcd18a914d1d: Status 404 returned error can't find the container with id c4407be28d4592858d52b9180ad52ddcb80b7635b72eeba1b4f1dcd18a914d1d Sep 08 09:20:09.308304 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:09.308287 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 09:20:09.692296 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:09.692202 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4g52/must-gather-n24jz" event={"ID":"5aba172f-a5b2-4cf3-adbd-b60f0e825323","Type":"ContainerStarted","Data":"c4407be28d4592858d52b9180ad52ddcb80b7635b72eeba1b4f1dcd18a914d1d"} Sep 08 09:20:10.015856 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:10.015821 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:10.071939 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:10.071902 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:16.728241 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:16.728200 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4g52/must-gather-n24jz" event={"ID":"5aba172f-a5b2-4cf3-adbd-b60f0e825323","Type":"ContainerStarted","Data":"6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7"} Sep 08 09:20:16.728700 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:16.728266 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4g52/must-gather-n24jz" event={"ID":"5aba172f-a5b2-4cf3-adbd-b60f0e825323","Type":"ContainerStarted","Data":"ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034"} Sep 08 09:20:16.744167 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:16.744088 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w4g52/must-gather-n24jz" podStartSLOduration=2.296114345 podStartE2EDuration="8.744069451s" totalImagesPullingTime="6.447955106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:20:16.742948071 +0000 UTC m=+1961.060404290" watchObservedRunningTime="2026-09-08 09:20:16.744069451 +0000 UTC m=+1961.061525669" Sep 08 09:20:26.772215 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:26.772164 2561 generic.go:356] "Generic (PLEG): container finished" podID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerID="ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034" exitCode=0 Sep 08 09:20:26.772663 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:26.772220 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4g52/must-gather-n24jz" event={"ID":"5aba172f-a5b2-4cf3-adbd-b60f0e825323","Type":"ContainerDied","Data":"ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034"} Sep 08 09:20:26.772663 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:26.772509 2561 scope.go:117] "RemoveContainer" containerID="ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034" Sep 08 09:20:26.899403 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:26.899366 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-w4g52_must-gather-n24jz_5aba172f-a5b2-4cf3-adbd-b60f0e825323/gather/0.log" Sep 08 09:20:27.248987 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:27.248946 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:27.397854 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:27.397763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:27.461116 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:27.461082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:30.046232 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:30.046201 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s4s94_16461164-6c50-4205-9337-d87538d7516f/global-pull-secret-syncer/0.log" Sep 08 09:20:30.152270 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:30.152239 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" Sep 08 09:20:30.233911 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:30.233887 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-205.ec2.internal_eaef65e55aa5f7053cfe7a3a8e382309/haproxy/0.log" Sep 08 09:20:32.224014 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.223976 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-w4g52/must-gather-n24jz"] Sep 08 09:20:32.224477 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.224194 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-w4g52/must-gather-n24jz" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="copy" containerID="cri-o://6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7" gracePeriod=2 Sep 08 09:20:32.228570 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.228534 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-w4g52/must-gather-n24jz"] Sep 08 09:20:32.459186 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.459155 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-w4g52_must-gather-n24jz_5aba172f-a5b2-4cf3-adbd-b60f0e825323/copy/0.log" Sep 08 09:20:32.461894 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.461868 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:32.464068 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:20:32.464032 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n24jz\" is forbidden: User \"system:node:ip-10-0-132-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-w4g52\": no relationship found between node 'ip-10-0-132-205.ec2.internal' and this object" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:32.465245 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.465227 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdrf7\" (UniqueName: \"kubernetes.io/projected/5aba172f-a5b2-4cf3-adbd-b60f0e825323-kube-api-access-tdrf7\") pod \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " Sep 08 09:20:32.465306 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.465268 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5aba172f-a5b2-4cf3-adbd-b60f0e825323-must-gather-output\") pod \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\" (UID: \"5aba172f-a5b2-4cf3-adbd-b60f0e825323\") " Sep 08 09:20:32.465659 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.465638 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aba172f-a5b2-4cf3-adbd-b60f0e825323-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "5aba172f-a5b2-4cf3-adbd-b60f0e825323" (UID: "5aba172f-a5b2-4cf3-adbd-b60f0e825323"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 09:20:32.467530 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.467502 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aba172f-a5b2-4cf3-adbd-b60f0e825323-kube-api-access-tdrf7" (OuterVolumeSpecName: "kube-api-access-tdrf7") pod "5aba172f-a5b2-4cf3-adbd-b60f0e825323" (UID: "5aba172f-a5b2-4cf3-adbd-b60f0e825323"). InnerVolumeSpecName "kube-api-access-tdrf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 09:20:32.566430 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.566382 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdrf7\" (UniqueName: \"kubernetes.io/projected/5aba172f-a5b2-4cf3-adbd-b60f0e825323-kube-api-access-tdrf7\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:20:32.566430 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.566422 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5aba172f-a5b2-4cf3-adbd-b60f0e825323-must-gather-output\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\"" Sep 08 09:20:32.795997 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.795963 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-w4g52_must-gather-n24jz_5aba172f-a5b2-4cf3-adbd-b60f0e825323/copy/0.log" Sep 08 09:20:32.796497 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.796468 2561 generic.go:356] "Generic (PLEG): container finished" podID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerID="6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7" exitCode=143 Sep 08 09:20:32.796611 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.796524 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:32.796611 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.796570 2561 scope.go:117] "RemoveContainer" containerID="6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7" Sep 08 09:20:32.799002 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:20:32.798960 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n24jz\" is forbidden: User \"system:node:ip-10-0-132-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-w4g52\": no relationship found between node 'ip-10-0-132-205.ec2.internal' and this object" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:32.805154 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.805122 2561 scope.go:117] "RemoveContainer" containerID="ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034" Sep 08 09:20:32.807189 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:20:32.807150 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-n24jz\" is forbidden: User \"system:node:ip-10-0-132-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-w4g52\": no relationship found between node 'ip-10-0-132-205.ec2.internal' and this object" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" pod="openshift-must-gather-w4g52/must-gather-n24jz" Sep 08 09:20:32.817175 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.817038 2561 scope.go:117] "RemoveContainer" containerID="6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7" Sep 08 09:20:32.817452 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:20:32.817425 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7\": container with ID starting with 6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7 not found: ID does not exist" containerID="6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7" Sep 08 09:20:32.817520 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.817462 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7"} err="failed to get container status \"6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7\": rpc error: code = NotFound desc = could not find container \"6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7\": container with ID starting with 6bd9d079e2054eb2dc7cdcbb3b245cc983e838f913431036b56e77404f9449d7 not found: ID does not exist" Sep 08 09:20:32.817520 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.817482 2561 scope.go:117] "RemoveContainer" containerID="ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034" Sep 08 09:20:32.817872 ip-10-0-132-205 kubenswrapper[2561]: E0908 09:20:32.817848 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034\": container with ID starting with ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034 not found: ID does not exist" containerID="ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034" Sep 08 09:20:32.817955 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.817877 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034"} err="failed to get container status \"ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034\": rpc error: code = NotFound desc = could not find container \"ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034\": container with ID starting with ed52f80720249ce43a3f7ec448950127e7776995745dc2552c9ada57df067034 not found: ID does not exist" Sep 08 09:20:32.818720 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.818693 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:32.883839 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:32.883805 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gzrff_4779b1eb-03c9-4dbe-873e-53748854da3a/konnectivity-agent/0.log" limit=1024 Sep 08 09:20:33.768145 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:33.768095 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-kw4dt_85d7825f-122f-47cf-a34c-184882f47edf/cluster-monitoring-operator/0.log" Sep 08 09:20:33.926641 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:33.926591 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f958f66cf-sjw75_0b588b80-d1aa-403e-94d8-326704a02d6e/metrics-server/0.log" Sep 08 09:20:34.210963 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.210869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnt6n_2300782b-77a4-44cc-8df5-16f823288572/node-exporter/0.log" Sep 08 09:20:34.212687 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.212656 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" path="/var/lib/kubelet/pods/5aba172f-a5b2-4cf3-adbd-b60f0e825323/volumes" Sep 08 09:20:34.239712 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.239683 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnt6n_2300782b-77a4-44cc-8df5-16f823288572/kube-rbac-proxy/0.log" Sep 08 09:20:34.270191 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.270165 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rnt6n_2300782b-77a4-44cc-8df5-16f823288572/init-textfile/0.log" Sep 08 09:20:34.727701 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.727671 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/thanos-query/0.log" Sep 08 09:20:34.752089 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.752059 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy-web/0.log" Sep 08 09:20:34.779833 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.779804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy/0.log" Sep 08 09:20:34.809878 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.809843 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/prom-label-proxy/0.log" Sep 08 09:20:34.837685 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.837652 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy-rules/0.log" Sep 08 09:20:34.864264 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:34.864237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69d767f884-7d7z4_0282f02b-7b78-4063-af76-6a498a90f1d9/kube-rbac-proxy-metrics/0.log" Sep 08 09:20:37.004679 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.004646 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6755f56697-5rkxw_ed12d6ec-8a5d-4f0e-9358-def6be42e954/console/0.log" Sep 08 09:20:37.035466 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.035421 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-thgbb_6cfdf44e-9527-4da5-916c-d946a9684824/download-server/0.log" Sep 08 09:20:37.502664 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.502629 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-5rhjw_0cbbac63-5578-43a4-8139-701f3406fa16/volume-data-source-validator/0.log" Sep 08 09:20:37.704089 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704046 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5"] Sep 08 09:20:37.704443 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704424 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="copy" Sep 08 09:20:37.704526 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704445 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="copy" Sep 08 09:20:37.704526 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704463 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="gather" Sep 08 09:20:37.704526 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704470 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="gather" Sep 08 09:20:37.704676 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704554 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="copy" Sep 08 09:20:37.704676 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.704570 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aba172f-a5b2-4cf3-adbd-b60f0e825323" containerName="gather" Sep 08 09:20:37.709642 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.709608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.711983 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.711951 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g27c6\"/\"default-dockercfg-pfqv4\"" Sep 08 09:20:37.711983 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.711958 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g27c6\"/\"openshift-service-ca.crt\"" Sep 08 09:20:37.712718 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.712695 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g27c6\"/\"kube-root-ca.crt\"" Sep 08 09:20:37.717426 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.717394 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5"] Sep 08 09:20:37.807823 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.807786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-lib-modules\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.808026 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.807843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-podres\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.808026 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.807899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt8xs\" (UniqueName: \"kubernetes.io/projected/25a71ab1-0368-4d4b-a6c9-198a7bb139be-kube-api-access-kt8xs\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.808026 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.807981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-sys\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.808165 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.808060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-proc\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909428 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-proc\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909428 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-lib-modules\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-podres\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt8xs\" (UniqueName: \"kubernetes.io/projected/25a71ab1-0368-4d4b-a6c9-198a7bb139be-kube-api-access-kt8xs\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-sys\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909539 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-proc\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-lib-modules\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-podres\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.909688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.909619 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25a71ab1-0368-4d4b-a6c9-198a7bb139be-sys\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:37.920900 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:37.919477 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt8xs\" (UniqueName: \"kubernetes.io/projected/25a71ab1-0368-4d4b-a6c9-198a7bb139be-kube-api-access-kt8xs\") pod \"perf-node-gather-daemonset-qbgj5\" (UID: \"25a71ab1-0368-4d4b-a6c9-198a7bb139be\") " pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:38.021868 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.021821 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:38.298407 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.298367 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5"] Sep 08 09:20:38.302415 ip-10-0-132-205 kubenswrapper[2561]: W0908 09:20:38.302382 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod25a71ab1_0368_4d4b_a6c9_198a7bb139be.slice/crio-f2176f0416ba23d6b35d9b3da8fbe47d6ac9a84d4681ec363ecee2c39e3adbce WatchSource:0}: Error finding container f2176f0416ba23d6b35d9b3da8fbe47d6ac9a84d4681ec363ecee2c39e3adbce: Status 404 returned error can't find the container with id f2176f0416ba23d6b35d9b3da8fbe47d6ac9a84d4681ec363ecee2c39e3adbce Sep 08 09:20:38.360007 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.359976 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhckf_b4dc8f1d-a522-454e-9a6b-63decf8f371c/dns/0.log" Sep 08 09:20:38.391432 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.391402 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhckf_b4dc8f1d-a522-454e-9a6b-63decf8f371c/kube-rbac-proxy/0.log" Sep 08 09:20:38.520536 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.520503 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cgbf_3fc98736-1625-4178-898d-173379416c5b/dns-node-resolver/0.log" Sep 08 09:20:38.822870 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.822836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" event={"ID":"25a71ab1-0368-4d4b-a6c9-198a7bb139be","Type":"ContainerStarted","Data":"0919089e7579e692d52e7f116d05884a5a7e8d0489d5999d84024302a9de3bb2"} Sep 08 09:20:38.823066 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.822886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" event={"ID":"25a71ab1-0368-4d4b-a6c9-198a7bb139be","Type":"ContainerStarted","Data":"f2176f0416ba23d6b35d9b3da8fbe47d6ac9a84d4681ec363ecee2c39e3adbce"} Sep 08 09:20:38.823066 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.822980 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:38.837991 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:38.837924 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" podStartSLOduration=1.837904006 podStartE2EDuration="1.837904006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:20:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:20:38.836876193 +0000 UTC m=+1983.154332411" watchObservedRunningTime="2026-09-08 09:20:38.837904006 +0000 UTC m=+1983.155360232" Sep 08 09:20:39.021030 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:39.020991 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74c598bc86-g59qs_97962ca3-8377-4406-9a63-38d0506e77d4/registry/0.log" Sep 08 09:20:39.134967 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:39.134888 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q78xr_d4b0ee56-8d0e-485f-b0e3-87d1f22d02cf/node-ca/0.log" Sep 08 09:20:39.844891 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:39.844859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c55f786f4-nxzlc_cf2212f1-f58b-4af1-a6d6-0136f525940e/router/0.log" Sep 08 09:20:40.201683 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:40.201600 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxt2r_fec8a155-9af6-4b8a-8f2c-b2ea5e7d59d4/serve-healthcheck-canary/0.log" Sep 08 09:20:40.532139 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:40.532093 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-b5rbh_4ef35c96-52a6-4a20-a073-503a365cfe7e/insights-operator/0.log" Sep 08 09:20:40.534003 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:40.533985 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-b5rbh_4ef35c96-52a6-4a20-a073-503a365cfe7e/insights-operator/1.log" Sep 08 09:20:40.615047 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:40.615011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knr98_13f80f01-4025-4197-9ed4-1fb449913610/kube-rbac-proxy/0.log" Sep 08 09:20:40.635614 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:40.635585 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knr98_13f80f01-4025-4197-9ed4-1fb449913610/exporter/0.log" Sep 08 09:20:40.658146 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:40.658109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-knr98_13f80f01-4025-4197-9ed4-1fb449913610/extractor/0.log" Sep 08 09:20:44.835990 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:44.835958 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g27c6/perf-node-gather-daemonset-qbgj5" Sep 08 09:20:45.725425 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.725390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2tw75_5d3e720e-855d-49df-9935-cee51a00f900/kube-multus/0.log" Sep 08 09:20:45.775583 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.775554 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/kube-multus-additional-cni-plugins/0.log" Sep 08 09:20:45.800572 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.800542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/egress-router-binary-copy/0.log" Sep 08 09:20:45.828064 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.828036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/cni-plugins/0.log" Sep 08 09:20:45.851237 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.851200 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/bond-cni-plugin/0.log" Sep 08 09:20:45.873287 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.873259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/routeoverride-cni/0.log" Sep 08 09:20:45.897251 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.897220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/whereabouts-cni-bincopy/0.log" Sep 08 09:20:45.919767 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:45.919721 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6zk7p_aa12bc65-8115-4916-9cef-e702b1607378/whereabouts-cni/0.log" Sep 08 09:20:46.363589 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:46.363558 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-krcc8_030a7a26-d668-4f3f-8078-b7ed24dab6fc/network-metrics-daemon/0.log" Sep 08 09:20:46.387099 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:46.387066 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-krcc8_030a7a26-d668-4f3f-8078-b7ed24dab6fc/kube-rbac-proxy/0.log" Sep 08 09:20:47.444814 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.444720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/ovn-controller/0.log" Sep 08 09:20:47.464413 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.464384 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/ovn-acl-logging/0.log" Sep 08 09:20:47.489526 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.489488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/kube-rbac-proxy-node/0.log" Sep 08 09:20:47.512928 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.512875 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 09:20:47.532926 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.532895 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/northd/0.log" Sep 08 09:20:47.555416 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.555382 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/nbdb/0.log" Sep 08 09:20:47.577623 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.577590 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/sbdb/0.log" Sep 08 09:20:47.618788 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:47.618727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6zpw_63a95f25-5e90-4a7d-aad8-d11c4adea633/ovnkube-controller/0.log" Sep 08 09:20:48.861322 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:48.861288 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cb5sh_ebae9480-b9a6-479e-9e97-521e48b4ea98/network-check-target-container/0.log" Sep 08 09:20:49.702406 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:49.702375 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2rz5g_d447ddf8-b445-4684-ac1f-ddf307cfab4c/iptables-alerter/0.log" Sep 08 09:20:50.354837 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:50.354806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-74rcv_9e78720e-40a0-460a-9cf3-1219bf3fd8a9/tuned/0.log" Sep 08 09:20:52.090096 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:52.090059 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-pbw9j_09bd8521-7cc8-4d9c-8c4f-23216ebd2745/cluster-samples-operator/0.log" Sep 08 09:20:52.122529 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:52.122500 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-pbw9j_09bd8521-7cc8-4d9c-8c4f-23216ebd2745/cluster-samples-operator-watch/0.log" Sep 08 09:20:53.276208 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:53.276174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-75d99c484-hbvz8_bc07df90-d9f7-43e4-a57f-e7092ad6d5a6/service-ca-controller/0.log" Sep 08 09:20:53.635688 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:53.635604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-9sqvn_64148ce7-3db4-4b93-ac86-6595bf258483/csi-driver/0.log" Sep 08 09:20:53.656837 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:53.656810 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-9sqvn_64148ce7-3db4-4b93-ac86-6595bf258483/csi-node-driver-registrar/0.log" Sep 08 09:20:53.678498 ip-10-0-132-205 kubenswrapper[2561]: I0908 09:20:53.678467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-9sqvn_64148ce7-3db4-4b93-ac86-6595bf258483/csi-liveness-probe/0.log"