Jun 11 23:36:15.435210 ip-10-0-134-3 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 11 23:36:15.435222 ip-10-0-134-3 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 11 23:36:15.435231 ip-10-0-134-3 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 11 23:36:15.435531 ip-10-0-134-3 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 11 23:36:25.681862 ip-10-0-134-3 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 11 23:36:25.681880 ip-10-0-134-3 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0a02501cb59f4497b0f490dd7e0a5100 --
Jun 11 23:38:41.255597 ip-10-0-134-3 systemd[1]: Starting Kubernetes Kubelet...
Jun 11 23:38:41.670857 ip-10-0-134-3 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 23:38:41.670857 ip-10-0-134-3 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 11 23:38:41.670857 ip-10-0-134-3 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 23:38:41.670857 ip-10-0-134-3 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 11 23:38:41.670857 ip-10-0-134-3 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 11 23:38:41.673188 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.673112    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 11 23:38:41.678745 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678723    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 23:38:41.678745 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678740    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 23:38:41.678745 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678744    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 23:38:41.678745 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678748    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 23:38:41.678745 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678751    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 23:38:41.678745 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678754    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678759    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678762    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678766    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678769    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678771    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678774    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678777    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678780    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678782    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678785    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678787    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678790    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678793    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678795    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678799    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678801    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678804    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678807    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 23:38:41.678972 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678809    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678813    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678817    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678821    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678824    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678826    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678829    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678832    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678834    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678837    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678840    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678842    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678845    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678847    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678850    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678853    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678856    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678858    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678861    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 23:38:41.679466 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678864    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678866    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678869    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678872    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678874    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678877    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678880    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678883    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678887    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678889    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678893    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678896    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678899    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678902    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678905    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678907    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678910    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678913    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678915    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678918    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 23:38:41.679929 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678920    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678923    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678926    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678935    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678939    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678941    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678944    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678947    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678950    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678953    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678955    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678958    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678961    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678964    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678966    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678969    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678972    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678974    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678977    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 23:38:41.680436 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678980    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678985    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678989    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678992    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678995    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.678998    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679001    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679004    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679007    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679010    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679012    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679015    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679018    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679020    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679023    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679025    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679028    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679744    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679750    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679754    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 23:38:41.680921 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679757    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679760    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679764    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679767    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679770    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679772    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679775    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679777    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679780    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679783    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679786    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679788    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679791    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679793    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679798    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679802    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679805    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679808    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679812    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679815    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 23:38:41.681406 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679817    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679820    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679822    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679825    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679828    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679830    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679833    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679835    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679838    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679840    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679843    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679845    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679848    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679851    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679854    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679857    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679860    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679862    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679865    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679867    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 23:38:41.681907 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679870    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679872    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679876    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679879    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679882    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679884    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679887    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679891    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679894    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679896    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679899    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679901    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679904    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679907    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679909    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679912    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679914    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679917    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679920    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 23:38:41.682411 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679922    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679924    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679927    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679929    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679932    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679934    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679938    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679940    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679943    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679945    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679948    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679951    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679953    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679956    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679975    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679979    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679982    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679985    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679988    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679990    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 23:38:41.682876 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679993    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.679996    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680000    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680004    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680008    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680012    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680015    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680018    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680021    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680023    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680026    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680029    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680032    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680035    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680037    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680040    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680042    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680405    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680411    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 23:38:41.683405 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680414    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680416    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680419    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680422    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680425    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680427    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680430    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680433    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680436    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680439    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680441    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680444    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680447    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680450    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680453    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680456    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680459    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680461    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680464    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680467    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 23:38:41.683867 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680469    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680472    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680474    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680477    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680479    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680482    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680486    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680490    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680492    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680496    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680499    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680502    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680505    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680507    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680509    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680512    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680515    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680517    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680519    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680522    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 23:38:41.684378 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680524    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680527    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680529    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680532    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680534    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680537    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680539    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680543    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680546    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680548    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680550    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680556    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680558    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680561    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680563    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680566    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680568    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680571    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680573    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680576    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 23:38:41.684912 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680578    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680581    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680583    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680588    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680591    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680594    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680597    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680601    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680604    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680607    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680610    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680613    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680616    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680619    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680622    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680624    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680626    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680629    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680631    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 23:38:41.685414 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680634    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680637    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680640    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680642    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680645    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680647    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680650    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680652    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680655    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680658    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680660    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680662    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680665    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680667    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680670    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680672    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680675    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.680677    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680744    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680751    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680757    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jun 11 23:38:41.685994 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680762    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680768    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680772    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680779    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680785    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680789    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680792    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680796    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680799    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680802    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680806    2575 flags.go:64] FLAG: --cgroup-root=""
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680811    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680815    2575 flags.go:64] FLAG: --client-ca-file=""
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680819    2575 flags.go:64] FLAG: --cloud-provider="external"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680822    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680827    2575 flags.go:64] FLAG: --cluster-domain=""
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680829    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680832    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680835    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680839    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680842    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680845    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680848    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 11 23:38:41.686565 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680852    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680855    2575 flags.go:64] FLAG: --contention-profiling="false"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680858    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680860    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680863    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680866    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680870    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680873    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680876    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680879    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680882    2575 flags.go:64] FLAG: --enable-server="true"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680885    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680889    2575 flags.go:64] FLAG: --event-burst="100"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680892    2575 flags.go:64] FLAG: --event-qps="50"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680895    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680898    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680901    2575 flags.go:64] FLAG: --eviction-hard=""
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680905    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680907    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680910    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680915    2575 flags.go:64] FLAG: --eviction-soft=""
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680917    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680920    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680928    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680931    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 11 23:38:41.687124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680934    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680937    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680940    2575 flags.go:64] FLAG: --feature-gates=""
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680944    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680947    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680950    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680953    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680956    2575 flags.go:64] FLAG: --healthz-port="10248"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680959    2575 flags.go:64] FLAG: --help="false"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680962    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680965    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680968    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680970    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680974    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680977    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680980    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680982    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680985    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680988    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680991    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680994    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680996    2575 flags.go:64] FLAG: --kube-reserved=""
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.680999    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681002    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 11 23:38:41.687777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681005    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681007    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681013    2575 flags.go:64] FLAG: --lock-file=""
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681017    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681021    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681023    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681029    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681032    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681035    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681038    2575 flags.go:64] FLAG: --logging-format="text"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681041    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681044    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681047    2575 flags.go:64] FLAG: --manifest-url=""
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681050    2575 flags.go:64] FLAG: --manifest-url-header=""
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681054    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681057    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681061    2575 flags.go:64] FLAG: --max-pods="110"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681064    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681067    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681069    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681072    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681075    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681078    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681081    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681088    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jun 11 23:38:41.688384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681091    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681094    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681097    2575 flags.go:64] FLAG: --pod-cidr=""
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681099    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681105    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681107    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681110    2575 flags.go:64] FLAG: --pods-per-core="0"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681113    2575 flags.go:64] FLAG: --port="10250"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681116    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681119    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-094cdac833529837e"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681125    2575 flags.go:64] FLAG: --qos-reserved=""
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681128    2575 flags.go:64] FLAG: --read-only-port="10255"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681131    2575 flags.go:64] FLAG: --register-node="true"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681133    2575 flags.go:64] FLAG: --register-with-taints=""
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681137    2575 flags.go:64] FLAG: --registry-burst="10"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681141    2575 flags.go:64] FLAG: --registry-qps="5"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681144    2575 flags.go:64] FLAG: --reserved-cpus=""
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681146    2575 flags.go:64] FLAG: --reserved-memory=""
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681150    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681153    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681156    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681158    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681161    2575 flags.go:64] FLAG: --runonce="false"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681164    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681167    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 11 23:38:41.689000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681170    2575 flags.go:64] FLAG: --seccomp-default="false"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681173    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681175    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681178    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681181    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681184    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681187    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681190    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681192    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681195    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681198    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681201    2575 flags.go:64] FLAG: --system-cgroups=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681204    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681209    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681212    2575 flags.go:64] FLAG: --tls-cert-file=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681214    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681219    2575 flags.go:64] FLAG: --tls-min-version=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681225    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681228    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681231    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681233    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681236    2575 flags.go:64] FLAG: --v="2"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681245    2575 flags.go:64] FLAG: --version="false"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681250    2575 flags.go:64] FLAG: --vmodule=""
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681253    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 11 23:38:41.689614 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.681256    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681386    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681390    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681394    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681397    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681399    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681403    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681405    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681408    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681411    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681414    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681417    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681420    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681423    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681425    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681430    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681433    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681437    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681440    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681443    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 23:38:41.690267 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681446    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681448    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681452    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681454    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681460    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681462    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681465    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681467    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681470    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681472    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681475    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681479    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681481    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681485    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681487    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681489    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681492    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681496    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681499    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 23:38:41.690790 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681502    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681505    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681508    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681511    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681514    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681517    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681520    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681523    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681525    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681528    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681531    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681533    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681536    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681538    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681541    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681543    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681546    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681552    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681554    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 23:38:41.691262 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681557    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681559    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681562    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681565    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681567    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681570    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681573    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681575    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681578    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681580    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681583    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681585    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681588    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681590    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681593    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681595    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681598    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681600    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681603    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681605    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 23:38:41.691747 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681608    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681610    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681613    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681616    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681618    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681620    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681623    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681625    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681628    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681631    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681636    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681639    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681641    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681644    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681646    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681649    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681651    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681654    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681657    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681660    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 23:38:41.692239 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681662    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.681665    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.682564    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.689202    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.689296    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.689312    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.689318    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689386    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689392    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689395    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689399    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689402    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689405    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689408    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689411    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 23:38:41.692754 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689414    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689416    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689419    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689422    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689425    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689427    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689430    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689433    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689435    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689438    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689440    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689443    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689446    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689449    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689451    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689454    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689457    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689459    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689462    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689464    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 23:38:41.693121 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689467    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689471    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689473    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689477    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689481    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689484    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689487    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689490    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689492    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689495    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689497    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689500    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689502    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689505    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689508    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689510    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689513    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689515    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689520    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 23:38:41.693622 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689523    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689526    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689529    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689532    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689535    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689537    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689540    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689543    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689545    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689548    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689551    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689553    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689556    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689559    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689563    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689566    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689569    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689572    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689575    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689577    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 23:38:41.694099 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689580    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689582    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689585    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689588    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689590    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689593    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689596    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689598    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689600    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689603    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689606    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689608    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689611    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689613    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689617    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689621    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689624    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689627    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689630    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 23:38:41.694606 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689633    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689635    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689638    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689641    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689643    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689646    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689649    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689651    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689654    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689657    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689660    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689662    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689665    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.689670    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689787    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 11 23:38:41.695066 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689793    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689796    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689799    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689802    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689805    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689808    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689811    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689814    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689816    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689819    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689822    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689827    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689830    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689833    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689836    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689838    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689841    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689844    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689846    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 11 23:38:41.695617 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689849    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689851    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689854    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689856    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689859    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689862    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689865    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689867    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689870    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689873    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689875    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689878    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689881    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689883    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689886    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689888    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689891    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689893    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689896    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 11 23:38:41.696065 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689898    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689902    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689905    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689908    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689911    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689914    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689918    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689921    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689924    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689926    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689928    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689931    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689933    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689936    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689938    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689941    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689943    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689946    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689949    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 11 23:38:41.696552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689952    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689954    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689957    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689960    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689963    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689965    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689968    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689970    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689973    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689975    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689978    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689980    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689983    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689985    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689988    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689990    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689994    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689996    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.689999    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690001    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 11 23:38:41.697019 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690004    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690006    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690009    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690011    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690014    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690016    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690019    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690021    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690024    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690026    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690029    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690031    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690034    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690036    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690039    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690041    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690044    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690046    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690049    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690052    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 11 23:38:41.697507 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:41.690054    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.690059    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.690153    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.692638    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.694289    2575 server.go:1019] "Starting client certificate rotation"
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.694391    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.695235    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.696896    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 23:38:41.698003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.697985    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 11 23:38:41.712221 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.712202    2575 log.go:25] "Validated CRI v1 runtime API"
Jun 11 23:38:41.714827 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.714811    2575 log.go:25] "Validated CRI v1 image API"
Jun 11 23:38:41.716290 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.716273    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 11 23:38:41.718521 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.718503    2575 fs.go:135] Filesystem UUIDs: map[1c1bdf23-e8ae-4301-b0af-473b6b42713a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ea841b22-4cfe-4fc4-9f37-c8cc7aad2c65:/dev/nvme0n1p4]
Jun 11 23:38:41.718582 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.718521    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 11 23:38:41.722669 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.722644    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 23:38:41.724349 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.724219    2575 manager.go:216] Machine: {Timestamp:2026-06-11 23:38:41.723014843 +0000 UTC m=+0.348088066 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095437 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec246e5f35d8f3144ad4d1696abe8aa8 SystemUUID:ec246e5f-35d8-f314-4ad4-d1696abe8aa8 BootID:0a02501c-b59f-4497-b0f4-90dd7e0a5100 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:3f:d2:c6:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:3f:d2:c6:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:b7:18:4e:be:d7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 11 23:38:41.724349 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.724342    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 11 23:38:41.724503 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.724434    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 11 23:38:41.728788 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.728767    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 11 23:38:41.728922 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.728791    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-3.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 11 23:38:41.729600 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.729590    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jun 11 23:38:41.729638 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.729602    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jun 11 23:38:41.729638 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.729610    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 23:38:41.730398 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.730387    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 11 23:38:41.731665 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.731655    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 11 23:38:41.734878 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.734866    2575 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 23:38:41.734991 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.734982    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 11 23:38:41.735090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735009    2575 kubelet.go:486] "Attempting to sync node with API server"
Jun 11 23:38:41.735090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735034    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 11 23:38:41.735090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735048    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 11 23:38:41.735090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735057    2575 kubelet.go:398] "Adding apiserver pod source"
Jun 11 23:38:41.735090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735065    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 11 23:38:41.735444 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735432    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 23:38:41.735499 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.735452    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 11 23:38:41.737900 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.737880    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 11 23:38:41.739272 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739260    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 11 23:38:41.739351 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739289    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 11 23:38:41.739454 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739445    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 11 23:38:41.739490 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739459    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 11 23:38:41.739490 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739464    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 11 23:38:41.739490 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739476    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 11 23:38:41.739490 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739484    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 11 23:38:41.739490 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.739490    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 11 23:38:41.740143 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.740134    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 11 23:38:41.740175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.740143    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 11 23:38:41.740175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.740150    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 11 23:38:41.740175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.740155    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 11 23:38:41.740175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.740167    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 11 23:38:41.740175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.740174    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 11 23:38:41.741630 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.741615    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 11 23:38:41.741630 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.741627    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 11 23:38:41.741898 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.741866    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxlkp"
Jun 11 23:38:41.744195 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.744169    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-3.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 11 23:38:41.744272 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.744196    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 11 23:38:41.744272 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.744214    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-3.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 11 23:38:41.744615 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.744604    2575 server.go:1268] "Started kubelet"
Jun 11 23:38:41.744734 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.744677    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 11 23:38:41.744734 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.744670    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 11 23:38:41.744836 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.744759    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 11 23:38:41.745430 ip-10-0-134-3 systemd[1]: Started Kubernetes Kubelet.
Jun 11 23:38:41.746664 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.746645    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 11 23:38:41.749795 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.749771    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxlkp"
Jun 11 23:38:41.750982 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.750957    2575 server.go:310] "Adding debug handlers to kubelet server"
Jun 11 23:38:41.753488 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.753467    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 11 23:38:41.754046 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.753084    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-3.ec2.internal.18b82b2c44022805  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-3.ec2.internal,UID:ip-10-0-134-3.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-3.ec2.internal,},FirstTimestamp:2026-06-11 23:38:41.744578565 +0000 UTC m=+0.369651790,LastTimestamp:2026-06-11 23:38:41.744578565 +0000 UTC m=+0.369651790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-3.ec2.internal,}"
Jun 11 23:38:41.754724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.754710    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 11 23:38:41.754786 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.754710    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 11 23:38:41.754835 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.754788    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:41.755291 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.755272    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 11 23:38:41.755515 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.755495    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 11 23:38:41.755515 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.755514    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 11 23:38:41.755651 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.755621    2575 reconstruct.go:97] "Volume reconstruction finished"
Jun 11 23:38:41.755651 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.755628    2575 reconciler.go:29] "Reconciler: start to sync state"
Jun 11 23:38:41.755981 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.755965    2575 factory.go:55] Registering systemd factory
Jun 11 23:38:41.756079 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.756070    2575 factory.go:223] Registration of the systemd container factory successfully
Jun 11 23:38:41.756853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.756707    2575 factory.go:153] Registering CRI-O factory
Jun 11 23:38:41.756853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.756723    2575 factory.go:223] Registration of the crio container factory successfully
Jun 11 23:38:41.756853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.756779    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 11 23:38:41.756853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.756800    2575 factory.go:103] Registering Raw factory
Jun 11 23:38:41.756853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.756812    2575 manager.go:1196] Started watching for new ooms in manager
Jun 11 23:38:41.757165 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.757153    2575 manager.go:349] Starting recovery of all containers
Jun 11 23:38:41.765612 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.765591    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 23:38:41.766711 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.766697    2575 manager.go:354] Recovery completed
Jun 11 23:38:41.769862 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.769842    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-3.ec2.internal\" not found" node="ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.771476 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.771464    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.773059 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773044    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.773113 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773070    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.773113 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773085    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.773632 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773616    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 11 23:38:41.773683 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773634    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.773741 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773633    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 11 23:38:41.773741 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.773721    2575 state_mem.go:36] "Initialized new in-memory state store"
Jun 11 23:38:41.774405 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.774390    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.774462 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.774418    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.774462 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.774429    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.774819 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.774808    2575 policy_none.go:49] "None policy: Start"
Jun 11 23:38:41.774857 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.774824    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 11 23:38:41.774857 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.774836    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 11 23:38:41.775752 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.775739    2575 policy_none.go:47] "Start"
Jun 11 23:38:41.814888 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.814868    2575 manager.go:337] "Starting Device Plugin manager"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.814903    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.814912    2575 server.go:87] "Starting device plugin registration server"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.815109    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.815122    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.815194    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.815283    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.815292    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.816015    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.816067    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.816747    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.818038    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.818067    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.818086    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 11 23:38:41.819702 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.818116    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 11 23:38:41.820127 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.820068    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 23:38:41.916097 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.916069    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.916933 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.916918    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.917015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.916943    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.917015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.916953    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.917015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.916974    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.918841 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.918826    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"]
Jun 11 23:38:41.918885 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.918878    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.920118 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.920105    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.920168 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.920130    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.920168 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.920139    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.921304 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.921274    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.921418 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.921404    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.921463 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.921430    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.921918 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.921899    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.921978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.921927    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.921978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.921938    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.922527 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.922514    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.922585 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.922538    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.922585 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.922547    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.923575 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.923562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.923625 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.923586    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 11 23:38:41.924216 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.924203    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientMemory"
Jun 11 23:38:41.924216 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.924225    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasNoDiskPressure"
Jun 11 23:38:41.924371 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.924235    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeHasSufficientPID"
Jun 11 23:38:41.925542 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.925529    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.925614 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.925546    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-3.ec2.internal\": node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:41.939776 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.939760    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:41.944885 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.944872    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-3.ec2.internal\" not found" node="ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.948682 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:41.948667    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-3.ec2.internal\" not found" node="ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.955992 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.955973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e063605eb7d9a36e5f25819b65f91b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal\" (UID: \"7e063605eb7d9a36e5f25819b65f91b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.956076 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.956003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e063605eb7d9a36e5f25819b65f91b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal\" (UID: \"7e063605eb7d9a36e5f25819b65f91b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:41.956076 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:41.956029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c2aaf6ed69256f21f9f06c54d5921e8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-3.ec2.internal\" (UID: \"3c2aaf6ed69256f21f9f06c54d5921e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.040643 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.040628    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.057047 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.057031    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e063605eb7d9a36e5f25819b65f91b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal\" (UID: \"7e063605eb7d9a36e5f25819b65f91b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.057111 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.057053    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e063605eb7d9a36e5f25819b65f91b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal\" (UID: \"7e063605eb7d9a36e5f25819b65f91b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.057111 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.057068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c2aaf6ed69256f21f9f06c54d5921e8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-3.ec2.internal\" (UID: \"3c2aaf6ed69256f21f9f06c54d5921e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.057111 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.057088    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e063605eb7d9a36e5f25819b65f91b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal\" (UID: \"7e063605eb7d9a36e5f25819b65f91b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.057111 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.057107    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c2aaf6ed69256f21f9f06c54d5921e8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-3.ec2.internal\" (UID: \"3c2aaf6ed69256f21f9f06c54d5921e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.057234 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.057136    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e063605eb7d9a36e5f25819b65f91b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal\" (UID: \"7e063605eb7d9a36e5f25819b65f91b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.141612 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.141597    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.242368 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.242303    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.247457 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.247444    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.252439 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.252418    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.343024 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.343002    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.443518 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.443501    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.543981 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.543934    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.644456 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.644433    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.693886 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.693864    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 11 23:38:42.694392 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.694006    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 11 23:38:42.694392 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.694034    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 11 23:38:42.745320 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:42.745299    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-3.ec2.internal\" not found"
Jun 11 23:38:42.753110 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:42.753078    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e063605eb7d9a36e5f25819b65f91b1.slice/crio-6af8a84b4488f810a2fc68ee095ad72ecc85508052a6193ee063680df5d123c2 WatchSource:0}: Error finding container 6af8a84b4488f810a2fc68ee095ad72ecc85508052a6193ee063680df5d123c2: Status 404 returned error can't find the container with id 6af8a84b4488f810a2fc68ee095ad72ecc85508052a6193ee063680df5d123c2
Jun 11 23:38:42.753520 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:42.753499    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2aaf6ed69256f21f9f06c54d5921e8.slice/crio-f4bef6136162b1728db9cea8e208be5cb99ef75dc05ba0353a7feeaf5ecf0c06 WatchSource:0}: Error finding container f4bef6136162b1728db9cea8e208be5cb99ef75dc05ba0353a7feeaf5ecf0c06: Status 404 returned error can't find the container with id f4bef6136162b1728db9cea8e208be5cb99ef75dc05ba0353a7feeaf5ecf0c06
Jun 11 23:38:42.754995 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.754970    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 23:33:41 +0000 UTC" deadline="2027-12-03 13:11:42.522316112 +0000 UTC"
Jun 11 23:38:42.755060 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.754994    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12949h32m59.76732459s"
Jun 11 23:38:42.758086 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.758073    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 23:38:42.761370 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.761351    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 23:38:42.821423 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.821354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal" event={"ID":"3c2aaf6ed69256f21f9f06c54d5921e8","Type":"ContainerStarted","Data":"f4bef6136162b1728db9cea8e208be5cb99ef75dc05ba0353a7feeaf5ecf0c06"}
Jun 11 23:38:42.822278 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.822255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal" event={"ID":"7e063605eb7d9a36e5f25819b65f91b1","Type":"ContainerStarted","Data":"6af8a84b4488f810a2fc68ee095ad72ecc85508052a6193ee063680df5d123c2"}
Jun 11 23:38:42.855768 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.855748    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.867464 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.867448    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 23:38:42.869253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.869235    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal"
Jun 11 23:38:42.878682 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:42.878670    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 11 23:38:43.206947 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.206744    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 23:38:43.733948 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.733919    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 23:38:43.737020 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.737003    2575 apiserver.go:52] "Watching apiserver"
Jun 11 23:38:43.746327 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.746305    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 11 23:38:43.747681 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.747651    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-drf29","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-dtk6w","openshift-dns/node-resolver-kkkdw","openshift-multus/multus-additional-cni-plugins-92lbx","openshift-multus/multus-jrq9v","openshift-multus/network-metrics-daemon-5sgch","openshift-network-diagnostics/network-check-target-zdjh9","openshift-network-operator/iptables-alerter-hhbng","kube-system/global-pull-secret-syncer-jxqhp","kube-system/konnectivity-agent-zmksl","kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp","openshift-cluster-node-tuning-operator/tuned-r8jch"]
Jun 11 23:38:43.748951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.748932    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.750103 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.750084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.751319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.751289    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.751659 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.751641    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 11 23:38:43.751768 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.751743    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.751862 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.751848    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9wktr\""
Jun 11 23:38:43.751923 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.751897    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.752353 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.752321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.752471 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.752430    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.752791 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.752745    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ht582\""
Jun 11 23:38:43.752791 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.752758    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.753644 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.753622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 11 23:38:43.753750 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.753724    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.753821 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.753633    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.753912 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.753893    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2sxfv\""
Jun 11 23:38:43.754008 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.753951    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.754429 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.754412    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vs648\""
Jun 11 23:38:43.754723 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.754708    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 11 23:38:43.754723 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.754717    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.754918 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.754901    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.755097 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.755072    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 11 23:38:43.755709 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.755692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.756393 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.756196    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6b24q\""
Jun 11 23:38:43.756393 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.756325    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 11 23:38:43.756393 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.756383    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 11 23:38:43.757150 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.757131    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:43.757237 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.757198    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:43.757981 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.757960    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.758220 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.758184    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.758308 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.758218    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 11 23:38:43.758308 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.758260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:43.758436 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.758392    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:43.758678 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.758645    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lgbd9\""
Jun 11 23:38:43.758764 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.758693    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 11 23:38:43.759539 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.759521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.761186 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.761170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.761283 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.761246    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:43.761867 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.761849    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxxk7\""
Jun 11 23:38:43.761867 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.761862    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.762683 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.762667    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.762974 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.762958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.764105 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.764083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.765388 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.765282    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f2p6m\""
Jun 11 23:38:43.765388 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.765293    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 11 23:38:43.765388 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.765285    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 11 23:38:43.766473 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766451    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-modprobe-d\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.766569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766483    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysconfig\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.766569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-kubernetes\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.766569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.766569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f057821-6f06-40e3-8c1c-da609c5aff0a-cni-binary-copy\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.766766 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-netns\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.766766 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv7xt\" (UniqueName: \"kubernetes.io/projected/6f057821-6f06-40e3-8c1c-da609c5aff0a-kube-api-access-qv7xt\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.766766 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-host-slash\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.766766 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-registration-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.766766 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysctl-d\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.766766 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766753    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/140bde72-8309-4551-8328-e82f998d729f-tmp\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-socket-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-daemon-config\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-etc-kubernetes\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-iptables-alerter-script\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766921    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk5gd\" (UniqueName: \"kubernetes.io/projected/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-kube-api-access-rk5gd\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.767026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.766968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2f3392d-6d18-4719-bedb-0e416e2b52bf-agent-certs\") pod \"konnectivity-agent-zmksl\" (UID: \"b2f3392d-6d18-4719-bedb-0e416e2b52bf\") " pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.767468 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.767444    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-cni-bin\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.767536 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.767493    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-cni-multus\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.767742 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.767720    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 11 23:38:43.768102 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.768074    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 11 23:38:43.769001 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.768636    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-twrwr\""
Jun 11 23:38:43.769001 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.768708    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 11 23:38:43.769001 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.768868    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 11 23:38:43.769183 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769090    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 11 23:38:43.769183 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c2df9da-e961-487f-8d73-ed899abe70a8-serviceca\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.769183 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-system-cni-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769363 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysctl-conf\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.769363 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769262    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/140bde72-8309-4551-8328-e82f998d729f-etc-tuned\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.769363 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-sys-fs\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.769514 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-multus-certs\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769514 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-run\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.769514 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769491    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-var-lib-kubelet\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.769655 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769519    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-host\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.769655 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c2df9da-e961-487f-8d73-ed899abe70a8-host\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.769655 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769584    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2f3392d-6d18-4719-bedb-0e416e2b52bf-konnectivity-ca\") pod \"konnectivity-agent-zmksl\" (UID: \"b2f3392d-6d18-4719-bedb-0e416e2b52bf\") " pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.769655 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-cnibin\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769655 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-hostroot\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769675    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-lib-modules\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-device-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769746    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9l9\" (UniqueName: \"kubernetes.io/projected/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-kube-api-access-jd9l9\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769777    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-os-release\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-socket-dir-parent\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-conf-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.769889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-systemd\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.770199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-sys\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.770199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769940    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48zh\" (UniqueName: \"kubernetes.io/projected/140bde72-8309-4551-8328-e82f998d729f-kube-api-access-j48zh\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.770199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.769972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbmsl\" (UniqueName: \"kubernetes.io/projected/8c2df9da-e961-487f-8d73-ed899abe70a8-kube-api-access-hbmsl\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.770199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.770003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-cni-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.770199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.770045    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-k8s-cni-cncf-io\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.770199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.770191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-kubelet\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.770598 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.770564    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 11 23:38:43.787216 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.787150    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p45rb"
Jun 11 23:38:43.794781 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.794758    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p45rb"
Jun 11 23:38:43.856796 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.856772    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 11 23:38:43.871267 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871241    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-daemon-config\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.871382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-etc-kubernetes\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.871382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2f3392d-6d18-4719-bedb-0e416e2b52bf-agent-certs\") pod \"konnectivity-agent-zmksl\" (UID: \"b2f3392d-6d18-4719-bedb-0e416e2b52bf\") " pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.871382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-cni-multus\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.871382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-sys-fs\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6r2n\" (UniqueName: \"kubernetes.io/projected/54d9ef40-4514-470d-9759-ea08e6fe0130-kube-api-access-c6r2n\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871470    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-cni-multus\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871486    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c2df9da-e961-487f-8d73-ed899abe70a8-serviceca\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871512    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-sys-fs\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/140bde72-8309-4551-8328-e82f998d729f-etc-tuned\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-os-release\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-host\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.871596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-cnibin\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871633    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c2df9da-e961-487f-8d73-ed899abe70a8-host\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2f3392d-6d18-4719-bedb-0e416e2b52bf-konnectivity-ca\") pod \"konnectivity-agent-zmksl\" (UID: \"b2f3392d-6d18-4719-bedb-0e416e2b52bf\") " pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-cnibin\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871701    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-device-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6nhg\" (UniqueName: \"kubernetes.io/projected/4f0c8f0e-52ba-442b-8872-20b6387842f9-kube-api-access-z6nhg\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf9tv\" (UniqueName: \"kubernetes.io/projected/4e916115-6719-44ab-8afb-ccc4622a508a-kube-api-access-pf9tv\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871754    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbmsl\" (UniqueName: \"kubernetes.io/projected/8c2df9da-e961-487f-8d73-ed899abe70a8-kube-api-access-hbmsl\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871797    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c2df9da-e961-487f-8d73-ed899abe70a8-host\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-k8s-cni-cncf-io\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871816    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8c2df9da-e961-487f-8d73-ed899abe70a8-serviceca\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-modprobe-d\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysconfig\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.872037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.871949    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-daemon-config\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872062    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872092    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-env-overrides\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872099    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-modprobe-d\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872108    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysconfig\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-registration-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872129    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-k8s-cni-cncf-io\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872143    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-cnibin\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872189    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-host\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872210    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-device-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872258    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-registration-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872278    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-etc-kubernetes\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872284    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b2f3392d-6d18-4719-bedb-0e416e2b52bf-konnectivity-ca\") pod \"konnectivity-agent-zmksl\" (UID: \"b2f3392d-6d18-4719-bedb-0e416e2b52bf\") " pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872304    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-ovn\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872345    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-cni-netd\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.872743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysctl-d\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/140bde72-8309-4551-8328-e82f998d729f-tmp\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-log-socket\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-ovnkube-script-lib\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872514    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysctl-d\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872466    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872539    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-iptables-alerter-script\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872575    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk5gd\" (UniqueName: \"kubernetes.io/projected/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-kube-api-access-rk5gd\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872601    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-cni-bin\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysctl-conf\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872665    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-cni-bin\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872714    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872732    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-sysctl-conf\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872769    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-system-cni-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.873533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-slash\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872812    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-system-cni-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-var-lib-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e916115-6719-44ab-8afb-ccc4622a508a-ovn-node-metrics-cert\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872874    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54d9ef40-4514-470d-9759-ea08e6fe0130-tmp-dir\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-multus-certs\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872942    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-run\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-var-lib-kubelet\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-dbus\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.872999    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-multus-certs\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873014    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-run\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-systemd-units\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873060    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-var-lib-kubelet\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-iptables-alerter-script\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-hostroot\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-lib-modules\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.874259 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873142    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9l9\" (UniqueName: \"kubernetes.io/projected/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-kube-api-access-jd9l9\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873148    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-hostroot\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54d9ef40-4514-470d-9759-ea08e6fe0130-hosts-file\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-system-cni-dir\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873252    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-lib-modules\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-os-release\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-socket-dir-parent\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-conf-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-systemd\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873382    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-os-release\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-sys\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j48zh\" (UniqueName: \"kubernetes.io/projected/140bde72-8309-4551-8328-e82f998d729f-kube-api-access-j48zh\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873431    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-conf-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873430    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-socket-dir-parent\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-cni-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873460    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-sys\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873459    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-systemd\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-kubelet\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-kubernetes\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873515    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-multus-cni-dir\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873552    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-kubelet-config\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873562    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-var-lib-kubelet\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873584    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/140bde72-8309-4551-8328-e82f998d729f-etc-kubernetes\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-kubelet\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-run-netns\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-systemd\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f057821-6f06-40e3-8c1c-da609c5aff0a-cni-binary-copy\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-netns\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv7xt\" (UniqueName: \"kubernetes.io/projected/6f057821-6f06-40e3-8c1c-da609c5aff0a-kube-api-access-qv7xt\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873774    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-host-slash\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-etc-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873818    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6f057821-6f06-40e3-8c1c-da609c5aff0a-host-run-netns\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873824    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.875653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873866    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-host-slash\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873894    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-cni-bin\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxhww\" (UniqueName: \"kubernetes.io/projected/615ce39c-819f-46bf-9688-acb9626db9a7-kube-api-access-mxhww\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873945    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-socket-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.873967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-node-log\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.874005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-ovnkube-config\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.874068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-socket-dir\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.874171    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f057821-6f06-40e3-8c1c-da609c5aff0a-cni-binary-copy\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.875668    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b2f3392d-6d18-4719-bedb-0e416e2b52bf-agent-certs\") pod \"konnectivity-agent-zmksl\" (UID: \"b2f3392d-6d18-4719-bedb-0e416e2b52bf\") " pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.875698    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/140bde72-8309-4551-8328-e82f998d729f-tmp\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.876319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.876043    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/140bde72-8309-4551-8328-e82f998d729f-etc-tuned\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.880285 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.880228    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbmsl\" (UniqueName: \"kubernetes.io/projected/8c2df9da-e961-487f-8d73-ed899abe70a8-kube-api-access-hbmsl\") pod \"node-ca-drf29\" (UID: \"8c2df9da-e961-487f-8d73-ed899abe70a8\") " pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:43.880833 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.880810    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9l9\" (UniqueName: \"kubernetes.io/projected/caf3bf81-2274-4a5a-ac9e-9082faeabf8d-kube-api-access-jd9l9\") pod \"aws-ebs-csi-driver-node-7nxmp\" (UID: \"caf3bf81-2274-4a5a-ac9e-9082faeabf8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:43.881418 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.881393    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk5gd\" (UniqueName: \"kubernetes.io/projected/5ab67604-e71e-4ae6-a8d1-3cb867035ecf-kube-api-access-rk5gd\") pod \"iptables-alerter-hhbng\" (UID: \"5ab67604-e71e-4ae6-a8d1-3cb867035ecf\") " pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:43.884826 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.884660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48zh\" (UniqueName: \"kubernetes.io/projected/140bde72-8309-4551-8328-e82f998d729f-kube-api-access-j48zh\") pod \"tuned-r8jch\" (UID: \"140bde72-8309-4551-8328-e82f998d729f\") " pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:43.884826 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.884809    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv7xt\" (UniqueName: \"kubernetes.io/projected/6f057821-6f06-40e3-8c1c-da609c5aff0a-kube-api-access-qv7xt\") pod \"multus-jrq9v\" (UID: \"6f057821-6f06-40e3-8c1c-da609c5aff0a\") " pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:43.974838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.974838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54d9ef40-4514-470d-9759-ea08e6fe0130-hosts-file\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-system-cni-dir\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-kubelet-config\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-kubelet\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-run-netns\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54d9ef40-4514-470d-9759-ea08e6fe0130-hosts-file\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-systemd\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-etc-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975003    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-kubelet-config\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975032    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975038    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-run-netns\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975055 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.974948    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-system-cni-dir\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975035    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975071    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-etc-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975076    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-cni-bin\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975006    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-systemd\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975094    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-cni-bin\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975115    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxhww\" (UniqueName: \"kubernetes.io/projected/615ce39c-819f-46bf-9688-acb9626db9a7-kube-api-access-mxhww\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975121    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-kubelet\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-node-log\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975175    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-node-log\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-ovnkube-config\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6r2n\" (UniqueName: \"kubernetes.io/projected/54d9ef40-4514-470d-9759-ea08e6fe0130-kube-api-access-c6r2n\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-os-release\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-cnibin\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975344    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.975512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975383    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-cnibin\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f0c8f0e-52ba-442b-8872-20b6387842f9-os-release\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975539    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6nhg\" (UniqueName: \"kubernetes.io/projected/4f0c8f0e-52ba-442b-8872-20b6387842f9-kube-api-access-z6nhg\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf9tv\" (UniqueName: \"kubernetes.io/projected/4e916115-6719-44ab-8afb-ccc4622a508a-kube-api-access-pf9tv\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-env-overrides\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-ovn\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-cni-netd\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975740    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-log-socket\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-ovnkube-script-lib\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.975799    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-cni-netd\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976311 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975850    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-run-ovn\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.975871    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:38:44.475850975 +0000 UTC m=+3.100924209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975916    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-ovnkube-config\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-slash\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-var-lib-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e916115-6719-44ab-8afb-ccc4622a508a-ovn-node-metrics-cert\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54d9ef40-4514-470d-9759-ea08e6fe0130-tmp-dir\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-dbus\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976047    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-systemd-units\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976071    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-env-overrides\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.975974    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-log-socket\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976142    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-host-slash\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976208    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-dbus\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.976232    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:43.976909 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976244    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-systemd-units\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.977512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976260    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4e916115-6719-44ab-8afb-ccc4622a508a-var-lib-openvswitch\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.977512 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.976317    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:44.47630113 +0000 UTC m=+3.101374343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:43.977512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976351    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4e916115-6719-44ab-8afb-ccc4622a508a-ovnkube-script-lib\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.977512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976525    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f0c8f0e-52ba-442b-8872-20b6387842f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:43.977512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.976556    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54d9ef40-4514-470d-9759-ea08e6fe0130-tmp-dir\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.978242 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.978222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e916115-6719-44ab-8afb-ccc4622a508a-ovn-node-metrics-cert\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.981752 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.981733    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:38:43.981841 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.981759    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:38:43.981841 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.981771    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:43.981841 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:43.981823    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:44.481808614 +0000 UTC m=+3.106881828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:43.984377 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.984306    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6r2n\" (UniqueName: \"kubernetes.io/projected/54d9ef40-4514-470d-9759-ea08e6fe0130-kube-api-access-c6r2n\") pod \"node-resolver-kkkdw\" (UID: \"54d9ef40-4514-470d-9759-ea08e6fe0130\") " pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:43.984377 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.984366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxhww\" (UniqueName: \"kubernetes.io/projected/615ce39c-819f-46bf-9688-acb9626db9a7-kube-api-access-mxhww\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:43.984692 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.984670    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf9tv\" (UniqueName: \"kubernetes.io/projected/4e916115-6719-44ab-8afb-ccc4622a508a-kube-api-access-pf9tv\") pod \"ovnkube-node-dtk6w\" (UID: \"4e916115-6719-44ab-8afb-ccc4622a508a\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:43.984772 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:43.984694    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6nhg\" (UniqueName: \"kubernetes.io/projected/4f0c8f0e-52ba-442b-8872-20b6387842f9-kube-api-access-z6nhg\") pod \"multus-additional-cni-plugins-92lbx\" (UID: \"4f0c8f0e-52ba-442b-8872-20b6387842f9\") " pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:44.033902 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.033878    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 11 23:38:44.060994 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.060968    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hhbng"
Jun 11 23:38:44.069166 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.069149    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r8jch"
Jun 11 23:38:44.075707 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.075687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp"
Jun 11 23:38:44.083469 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.083449    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-drf29"
Jun 11 23:38:44.090015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.089997    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:38:44.095575 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.095558    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jrq9v"
Jun 11 23:38:44.102053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.102034    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kkkdw"
Jun 11 23:38:44.107713 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.107696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-92lbx"
Jun 11 23:38:44.112473 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.112458    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:38:44.480367 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.480276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:44.480367 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.480351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:44.480579 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.480423    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:44.480579 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.480435    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:44.480579 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.480484    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:45.480469901 +0000 UTC m=+4.105543112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:44.480579 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.480502    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:38:45.480493488 +0000 UTC m=+4.105566703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:44.581033 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.581011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:44.581170 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.581154    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:38:44.581229 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.581177    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:38:44.581229 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.581190    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:44.581353 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.581250    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:45.581231226 +0000 UTC m=+4.206304439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:44.596791 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.596733    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf3bf81_2274_4a5a_ac9e_9082faeabf8d.slice/crio-087eacb4dfb9c1f6e1248f66629486581979b8ac9930d965f9cb00cce5833576 WatchSource:0}: Error finding container 087eacb4dfb9c1f6e1248f66629486581979b8ac9930d965f9cb00cce5833576: Status 404 returned error can't find the container with id 087eacb4dfb9c1f6e1248f66629486581979b8ac9930d965f9cb00cce5833576
Jun 11 23:38:44.597523 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.597477    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f057821_6f06_40e3_8c1c_da609c5aff0a.slice/crio-538072d78ddfeabe1799ebcbe5d162b303b73098e489b0b321a9eb94da5b53dd WatchSource:0}: Error finding container 538072d78ddfeabe1799ebcbe5d162b303b73098e489b0b321a9eb94da5b53dd: Status 404 returned error can't find the container with id 538072d78ddfeabe1799ebcbe5d162b303b73098e489b0b321a9eb94da5b53dd
Jun 11 23:38:44.598552 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.598531    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f3392d_6d18_4719_bedb_0e416e2b52bf.slice/crio-5fb28dc5be069581cb0c0159777033955a04b43165ae3fdd5e6950f6c664ede2 WatchSource:0}: Error finding container 5fb28dc5be069581cb0c0159777033955a04b43165ae3fdd5e6950f6c664ede2: Status 404 returned error can't find the container with id 5fb28dc5be069581cb0c0159777033955a04b43165ae3fdd5e6950f6c664ede2
Jun 11 23:38:44.599150 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.599131    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0c8f0e_52ba_442b_8872_20b6387842f9.slice/crio-63599071c5cd4898a598567a1228eed271a9ccc4eb0054e1007166864a881349 WatchSource:0}: Error finding container 63599071c5cd4898a598567a1228eed271a9ccc4eb0054e1007166864a881349: Status 404 returned error can't find the container with id 63599071c5cd4898a598567a1228eed271a9ccc4eb0054e1007166864a881349
Jun 11 23:38:44.602603 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.602207    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2df9da_e961_487f_8d73_ed899abe70a8.slice/crio-68a9aab1d8df4d78f1102bf7a86b71388d11bd05523edde9006277717d1ffd20 WatchSource:0}: Error finding container 68a9aab1d8df4d78f1102bf7a86b71388d11bd05523edde9006277717d1ffd20: Status 404 returned error can't find the container with id 68a9aab1d8df4d78f1102bf7a86b71388d11bd05523edde9006277717d1ffd20
Jun 11 23:38:44.604210 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.604114    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab67604_e71e_4ae6_a8d1_3cb867035ecf.slice/crio-8f2057a6a4f2bef2507a58008ede5ad978fa7c59e97543605723fa0cc8504d75 WatchSource:0}: Error finding container 8f2057a6a4f2bef2507a58008ede5ad978fa7c59e97543605723fa0cc8504d75: Status 404 returned error can't find the container with id 8f2057a6a4f2bef2507a58008ede5ad978fa7c59e97543605723fa0cc8504d75
Jun 11 23:38:44.605324 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.605301    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140bde72_8309_4551_8328_e82f998d729f.slice/crio-9cf0a74c9c4986415afd5f649949f4389127e0d6c4422e834f3a86e8009d2f96 WatchSource:0}: Error finding container 9cf0a74c9c4986415afd5f649949f4389127e0d6c4422e834f3a86e8009d2f96: Status 404 returned error can't find the container with id 9cf0a74c9c4986415afd5f649949f4389127e0d6c4422e834f3a86e8009d2f96
Jun 11 23:38:44.607100 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.606634    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e916115_6719_44ab_8afb_ccc4622a508a.slice/crio-b9523e21e4ca3ff09246dbbcf6dca98dd02d175ac8ef5940c25d38647768910b WatchSource:0}: Error finding container b9523e21e4ca3ff09246dbbcf6dca98dd02d175ac8ef5940c25d38647768910b: Status 404 returned error can't find the container with id b9523e21e4ca3ff09246dbbcf6dca98dd02d175ac8ef5940c25d38647768910b
Jun 11 23:38:44.608769 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:38:44.608728    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d9ef40_4514_470d_9759_ea08e6fe0130.slice/crio-085617ba0caeb0d832353c852d7660cb94fb9b8c376c7c57abfac640e43c76ef WatchSource:0}: Error finding container 085617ba0caeb0d832353c852d7660cb94fb9b8c376c7c57abfac640e43c76ef: Status 404 returned error can't find the container with id 085617ba0caeb0d832353c852d7660cb94fb9b8c376c7c57abfac640e43c76ef
Jun 11 23:38:44.797193 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.797163    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:33:43 +0000 UTC" deadline="2028-01-05 08:43:39.016181694 +0000 UTC"
Jun 11 23:38:44.797548 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.797197    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13737h4m54.218989607s"
Jun 11 23:38:44.819217 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.819196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:44.819313 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:44.819297    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:44.826605 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.826581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal" event={"ID":"3c2aaf6ed69256f21f9f06c54d5921e8","Type":"ContainerStarted","Data":"c4517a3f2711cfa0348fe1bc2e6dd4257b18963a2e0bc462513f46c6f6656791"}
Jun 11 23:38:44.827743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.827720    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8jch" event={"ID":"140bde72-8309-4551-8328-e82f998d729f","Type":"ContainerStarted","Data":"9cf0a74c9c4986415afd5f649949f4389127e0d6c4422e834f3a86e8009d2f96"}
Jun 11 23:38:44.828698 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.828673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hhbng" event={"ID":"5ab67604-e71e-4ae6-a8d1-3cb867035ecf","Type":"ContainerStarted","Data":"8f2057a6a4f2bef2507a58008ede5ad978fa7c59e97543605723fa0cc8504d75"}
Jun 11 23:38:44.829618 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.829593    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-drf29" event={"ID":"8c2df9da-e961-487f-8d73-ed899abe70a8","Type":"ContainerStarted","Data":"68a9aab1d8df4d78f1102bf7a86b71388d11bd05523edde9006277717d1ffd20"}
Jun 11 23:38:44.830495 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.830476    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp" event={"ID":"caf3bf81-2274-4a5a-ac9e-9082faeabf8d","Type":"ContainerStarted","Data":"087eacb4dfb9c1f6e1248f66629486581979b8ac9930d965f9cb00cce5833576"}
Jun 11 23:38:44.831508 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.831490    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kkkdw" event={"ID":"54d9ef40-4514-470d-9759-ea08e6fe0130","Type":"ContainerStarted","Data":"085617ba0caeb0d832353c852d7660cb94fb9b8c376c7c57abfac640e43c76ef"}
Jun 11 23:38:44.832640 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.832619    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"b9523e21e4ca3ff09246dbbcf6dca98dd02d175ac8ef5940c25d38647768910b"}
Jun 11 23:38:44.833661 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.833643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerStarted","Data":"63599071c5cd4898a598567a1228eed271a9ccc4eb0054e1007166864a881349"}
Jun 11 23:38:44.834878 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.834858    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmksl" event={"ID":"b2f3392d-6d18-4719-bedb-0e416e2b52bf","Type":"ContainerStarted","Data":"5fb28dc5be069581cb0c0159777033955a04b43165ae3fdd5e6950f6c664ede2"}
Jun 11 23:38:44.835835 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:44.835816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrq9v" event={"ID":"6f057821-6f06-40e3-8c1c-da609c5aff0a","Type":"ContainerStarted","Data":"538072d78ddfeabe1799ebcbe5d162b303b73098e489b0b321a9eb94da5b53dd"}
Jun 11 23:38:45.489434 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.489397    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:45.489627 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.489471    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:45.489627 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.489573    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:45.489627 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.489593    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:45.489803 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.489650    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:38:47.489630863 +0000 UTC m=+6.114704081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:45.489803 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.489674    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:47.489660482 +0000 UTC m=+6.114733701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:45.590113 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.590077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:45.590282 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.590232    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:38:45.590282 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.590254    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:38:45.590282 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.590267    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:45.590478 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.590324    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:47.590306094 +0000 UTC m=+6.215379307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:45.798176 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.798060    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 23:33:43 +0000 UTC" deadline="2028-01-07 10:50:42.257684864 +0000 UTC"
Jun 11 23:38:45.798176 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.798124    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13787h11m56.459564989s"
Jun 11 23:38:45.819239 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.818598    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:45.819239 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.818746    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:45.819239 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.819091    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:45.819239 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:45.819194    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:45.845685 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.845657    2575 generic.go:356] "Generic (PLEG): container finished" podID="7e063605eb7d9a36e5f25819b65f91b1" containerID="2e30a8559729c8f745a5b75766f9b6396d21b8cb1f45e223617690619351e485" exitCode=0
Jun 11 23:38:45.845846 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.845757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal" event={"ID":"7e063605eb7d9a36e5f25819b65f91b1","Type":"ContainerDied","Data":"2e30a8559729c8f745a5b75766f9b6396d21b8cb1f45e223617690619351e485"}
Jun 11 23:38:45.860422 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:45.860368    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-3.ec2.internal" podStartSLOduration=3.860342362 podStartE2EDuration="3.860342362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:38:44.842751664 +0000 UTC m=+3.467824897" watchObservedRunningTime="2026-06-11 23:38:45.860342362 +0000 UTC m=+4.485415586"
Jun 11 23:38:46.819436 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:46.819053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:46.819436 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:46.819190    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:46.861543 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:46.861510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal" event={"ID":"7e063605eb7d9a36e5f25819b65f91b1","Type":"ContainerStarted","Data":"dcb9efc26701a355b34e27d15e60f4e79f560f9cfafa754f5aa026eec7c073cc"}
Jun 11 23:38:47.510977 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:47.510226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:47.510977 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:47.510296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:47.510977 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.510433    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:47.510977 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.510492    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:51.510475209 +0000 UTC m=+10.135548429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:47.510977 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.510882    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:47.510977 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.510936    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:38:51.510920047 +0000 UTC m=+10.135993280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:47.612206 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:47.611588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:47.612206 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.611790    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:38:47.612206 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.611809    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:38:47.612206 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.611822    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:47.612206 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.611878    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:51.611859573 +0000 UTC m=+10.236932786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:47.819351 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:47.819260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:47.819500 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.819414    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:47.819500 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:47.819468    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:47.819883 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:47.819561    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:48.818657 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:48.818624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:48.818832 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:48.818771    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:49.818760 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:49.818720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:49.819157 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:49.818841    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:49.819157 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:49.819074    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:49.819276 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:49.819209    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:50.819372 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:50.818913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:50.819372 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:50.819063    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:51.544516 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:51.543952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:51.544516 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:51.544034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:51.544516 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.544099    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:51.544516 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.544137    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:51.544516 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.544167    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:38:59.544146318 +0000 UTC m=+18.169219545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:51.544516 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.544186    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:59.54417849 +0000 UTC m=+18.169251701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:51.645077 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:51.645041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:51.645272 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.645233    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:38:51.645272 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.645257    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:38:51.645272 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.645271    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:51.645481 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.645352    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:38:59.645317842 +0000 UTC m=+18.270391060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:51.819365 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:51.819231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:51.819365 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.819350    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:51.819848 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:51.819390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:51.819848 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:51.819503    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:52.819118 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:52.819080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:52.819311 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:52.819230    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:53.819056 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:53.819025    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:53.819546 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:53.819025    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:53.819546 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:53.819147    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:53.819546 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:53.819230    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:54.818567 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:54.818537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:54.818729 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:54.818634    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:55.818705 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:55.818671    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:55.819151 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:55.818807    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:55.819151 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:55.818805    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:55.819151 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:55.818879    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:56.818569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:56.818343    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:56.818733 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:56.818679    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:57.818871 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:57.818838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:57.819282 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:57.818838    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:57.819282 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:57.818948    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:57.819282 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:57.819019    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:38:58.818897 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:58.818862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:58.819371 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:58.818984    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:38:59.609233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:59.609196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:38:59.609423 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:59.609263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:59.609423 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.609387    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:59.609536 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.609463    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:39:15.609441784 +0000 UTC m=+34.234515011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:38:59.609536 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.609389    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:59.609608 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.609550    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:39:15.609532208 +0000 UTC m=+34.234605432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:38:59.709787 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:59.709749    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:59.709954 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.709939    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:38:59.710010 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.709965    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:38:59.710010 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.709979    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:59.710125 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.710044    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:39:15.71002546 +0000 UTC m=+34.335098672 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:38:59.818651 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:59.818603    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:38:59.818815 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.818727    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:38:59.818878 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:38:59.818826    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:38:59.818961 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:38:59.818927    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:00.818278 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:00.818247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:00.818444 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:00.818379    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:01.819054 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:01.819012    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:01.819622 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:01.819128    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:01.819622 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:01.819221    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:01.819622 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:01.819344    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:02.818949 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.818923    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:02.819075 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:02.819054    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:02.891191 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.891159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmksl" event={"ID":"b2f3392d-6d18-4719-bedb-0e416e2b52bf","Type":"ContainerStarted","Data":"85501e600144c889451fe34faac7f2eace3da9b86b0ef89689f7723e2ceac580"}
Jun 11 23:39:02.893635 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.893586    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jrq9v" event={"ID":"6f057821-6f06-40e3-8c1c-da609c5aff0a","Type":"ContainerStarted","Data":"5df32bb55312b6ee84d331e59513087d0d4ea8b30dc0e603e18b96105a21fc04"}
Jun 11 23:39:02.895199 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.895171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r8jch" event={"ID":"140bde72-8309-4551-8328-e82f998d729f","Type":"ContainerStarted","Data":"3d34ee72ea01e68fd4ebe40ee4be4cd2a2aebc56f5ae53df09ae2c0c7a1fd726"}
Jun 11 23:39:02.896698 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.896670    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-drf29" event={"ID":"8c2df9da-e961-487f-8d73-ed899abe70a8","Type":"ContainerStarted","Data":"7d5380cad7f517b1e6918427d48a87dda908674044fd93db9f1a4d3819a7b37a"}
Jun 11 23:39:02.901467 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.901093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp" event={"ID":"caf3bf81-2274-4a5a-ac9e-9082faeabf8d","Type":"ContainerStarted","Data":"976cd587009f4d4c1b7879217c021974ce6695650a7f2ee0cbb795713c2a194b"}
Jun 11 23:39:02.903378 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.903358    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kkkdw" event={"ID":"54d9ef40-4514-470d-9759-ea08e6fe0130","Type":"ContainerStarted","Data":"e435f423f85f30e811b1bd1ab8f42bcc2a7efad355669e2a622a7852fee62ccc"}
Jun 11 23:39:02.905767 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.905729    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zmksl" podStartSLOduration=3.894645619 podStartE2EDuration="21.905715482s" totalImagesPullingTime="18.011069863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:02.905250658 +0000 UTC m=+21.530323891" watchObservedRunningTime="2026-06-11 23:39:02.905715482 +0000 UTC m=+21.530788713"
Jun 11 23:39:02.905951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.905933    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-3.ec2.internal" podStartSLOduration=20.90592898 podStartE2EDuration="20.90592898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:38:46.878928216 +0000 UTC m=+5.504001450" watchObservedRunningTime="2026-06-11 23:39:02.90592898 +0000 UTC m=+21.531002212"
Jun 11 23:39:02.933648 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.933414    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r8jch" podStartSLOduration=3.931596795 podStartE2EDuration="21.933395974s" totalImagesPullingTime="18.001799179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:02.932872212 +0000 UTC m=+21.557945446" watchObservedRunningTime="2026-06-11 23:39:02.933395974 +0000 UTC m=+21.558469207"
Jun 11 23:39:02.934080 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.934044    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kkkdw" podStartSLOduration=2.9338281029999997 podStartE2EDuration="20.934029546s" totalImagesPullingTime="18.000201443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:02.91826602 +0000 UTC m=+21.543339253" watchObservedRunningTime="2026-06-11 23:39:02.934029546 +0000 UTC m=+21.559102780"
Jun 11 23:39:02.946358 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:02.945901    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-drf29" podStartSLOduration=4.003140771 podStartE2EDuration="21.945881082s" totalImagesPullingTime="17.942740311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:02.945290223 +0000 UTC m=+21.570363456" watchObservedRunningTime="2026-06-11 23:39:02.945881082 +0000 UTC m=+21.570954345"
Jun 11 23:39:03.134865 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.134841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:39:03.135388 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.135320    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:39:03.818559 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.818527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:03.818733 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.818568    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:03.818733 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:03.818642    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:03.818814 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:03.818759    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:03.908110 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908086    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:39:03.908490 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908438    2575 generic.go:356] "Generic (PLEG): container finished" podID="4e916115-6719-44ab-8afb-ccc4622a508a" containerID="a9b4e23a874653375a263ba204171d24346127e1e1c7e3746caf280f0fc7f551" exitCode=1
Jun 11 23:39:03.908551 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908511    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"f3027779c4582f5c195b31fea6df609b5d3751ddcd438c5a3564d0f6461292ed"}
Jun 11 23:39:03.908606 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908596    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"4f5d7c017908be0accf6a8720d2138469c02e388083bc9651ebd7e70fefe1589"}
Jun 11 23:39:03.908660 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"472cf7a5ef1fd6bfe71eb125315dacd66644d233836b466673a9c2b103a43418"}
Jun 11 23:39:03.908713 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"0efe6e509800a67000d61a4e1206771c7f1c5d7b84e0ec21b705da3866e7800e"}
Jun 11 23:39:03.908768 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908753    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerDied","Data":"a9b4e23a874653375a263ba204171d24346127e1e1c7e3746caf280f0fc7f551"}
Jun 11 23:39:03.908820 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.908806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"db165677030e08aad77bb7399efc6ee4a58598d39e30aa85b7a5a19015e688ec"}
Jun 11 23:39:03.910079 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.910055    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0c8f0e-52ba-442b-8872-20b6387842f9" containerID="5167857287a2c6d8f9953c65b447cce21b25e4b01ce25ccbb601c4608f92b276" exitCode=0
Jun 11 23:39:03.910172 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.910147    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerDied","Data":"5167857287a2c6d8f9953c65b447cce21b25e4b01ce25ccbb601c4608f92b276"}
Jun 11 23:39:03.911008 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.910925    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:39:03.911432 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.911413    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zmksl"
Jun 11 23:39:03.927462 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.927418    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jrq9v" podStartSLOduration=4.875743153 podStartE2EDuration="22.927400476s" totalImagesPullingTime="18.051657323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:03.926505034 +0000 UTC m=+22.551578267" watchObservedRunningTime="2026-06-11 23:39:03.927400476 +0000 UTC m=+22.552473712"
Jun 11 23:39:03.997038 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:03.997007    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 11 23:39:04.819379 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.819346    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:04.819591 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:04.819481    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:04.825495 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.825405    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T23:39:03.997035014Z","UUID":"f156a647-2b53-448e-bc84-d0ecc737ce3c","Handler":null,"Name":"","Endpoint":""}
Jun 11 23:39:04.827613 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.827571    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 11 23:39:04.827738 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.827616    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 11 23:39:04.914432 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.914397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp" event={"ID":"caf3bf81-2274-4a5a-ac9e-9082faeabf8d","Type":"ContainerStarted","Data":"88339de1454cf4f6278ef5b9808f74a085b7efa2a4a35d2494af57ba807aa406"}
Jun 11 23:39:04.916296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.916266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hhbng" event={"ID":"5ab67604-e71e-4ae6-a8d1-3cb867035ecf","Type":"ContainerStarted","Data":"6a6fa78f3309f3b495aab34a6a6b9113e4facea28dc25ccdc4c9c9efef3732e3"}
Jun 11 23:39:04.932840 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:04.932790    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hhbng" podStartSLOduration=5.930928657 podStartE2EDuration="23.932773841s" totalImagesPullingTime="18.001845184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:04.932221134 +0000 UTC m=+23.557294378" watchObservedRunningTime="2026-06-11 23:39:04.932773841 +0000 UTC m=+23.557847077"
Jun 11 23:39:05.818669 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:05.818579    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:05.818815 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:05.818706    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:05.818815 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:05.818728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:05.818925 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:05.818886    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:05.920866 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:05.920828    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp" event={"ID":"caf3bf81-2274-4a5a-ac9e-9082faeabf8d","Type":"ContainerStarted","Data":"b3970671486f8d7ffff4b05e67ef66e40f3099650f772c080083e0d69297b7ff"}
Jun 11 23:39:05.924460 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:05.924435    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:39:05.924928 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:05.924889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"713bf85a989629f416ed672529fc3e8d1e27dd8e80c9e263a1c3409df50a9f8e"}
Jun 11 23:39:05.940957 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:05.940905    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nxmp" podStartSLOduration=4.830903728 podStartE2EDuration="24.940886569s" totalImagesPullingTime="20.109982841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:05.94084913 +0000 UTC m=+24.565922364" watchObservedRunningTime="2026-06-11 23:39:05.940886569 +0000 UTC m=+24.565959793"
Jun 11 23:39:06.818365 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:06.818320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:06.818531 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:06.818473    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:07.818683 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:07.818652    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:07.819203 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:07.818774    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:07.819203 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:07.818829    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:07.819203 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:07.818940    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:08.819065 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.818909    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:08.819437 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:08.819132    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:08.935091 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.935071    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:39:08.935430 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.935401    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"4627f5f510ec96affd17fd39294ed44533bb3bfefeadceaa9c6a2d37622c0a7b"}
Jun 11 23:39:08.935649 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.935629    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:39:08.935724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.935698    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:39:08.935834 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.935816    2575 scope.go:117] "RemoveContainer" containerID="a9b4e23a874653375a263ba204171d24346127e1e1c7e3746caf280f0fc7f551"
Jun 11 23:39:08.937264 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.937229    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0c8f0e-52ba-442b-8872-20b6387842f9" containerID="aeba5d35e08eed5d8fcb99c8f766cb0577ab15ea882e030168429171848165ca" exitCode=0
Jun 11 23:39:08.937264 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.937262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerDied","Data":"aeba5d35e08eed5d8fcb99c8f766cb0577ab15ea882e030168429171848165ca"}
Jun 11 23:39:08.951986 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:08.951968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:39:09.819435 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.819261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:09.819783 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.819281    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:09.819783 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:09.819549    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:09.819783 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:09.819604    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:09.943236 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.943209    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:39:09.943585 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.943561    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" event={"ID":"4e916115-6719-44ab-8afb-ccc4622a508a","Type":"ContainerStarted","Data":"d848a22d0f5da5c62dfbe9d3726c88fb862ebee734c2222d913e303ee0c66dbc"}
Jun 11 23:39:09.943860 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.943831    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:39:09.945725 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.945701    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0c8f0e-52ba-442b-8872-20b6387842f9" containerID="820b0c071036850016183e5b3d221d860caaeaf249931311a6a9772a404cb505" exitCode=0
Jun 11 23:39:09.945828 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.945748    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerDied","Data":"820b0c071036850016183e5b3d221d860caaeaf249931311a6a9772a404cb505"}
Jun 11 23:39:09.958506 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.958487    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:39:09.970134 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:09.970097    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w" podStartSLOduration=9.716556506 podStartE2EDuration="27.970085665s" totalImagesPullingTime="18.253529159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:09.968297017 +0000 UTC m=+28.593370250" watchObservedRunningTime="2026-06-11 23:39:09.970085665 +0000 UTC m=+28.595158897"
Jun 11 23:39:10.022469 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.022446    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5sgch"]
Jun 11 23:39:10.022589 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.022532    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:10.022643 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:10.022616    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:10.025663 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.025641    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxqhp"]
Jun 11 23:39:10.025759 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.025725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:10.025841 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:10.025819    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:10.026466 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.026447    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zdjh9"]
Jun 11 23:39:10.026570 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.026535    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:10.026654 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:10.026634    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:10.950573 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.950543    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0c8f0e-52ba-442b-8872-20b6387842f9" containerID="0b67ec51bd2a5a1a92a15377d6080f59a6cd8421eb407f4287b3b1d535ea055a" exitCode=0
Jun 11 23:39:10.951095 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:10.950612    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerDied","Data":"0b67ec51bd2a5a1a92a15377d6080f59a6cd8421eb407f4287b3b1d535ea055a"}
Jun 11 23:39:11.822942 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:11.822916    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:11.823120 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:11.823021    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:11.823120 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:11.823026    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:11.823120 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:11.823074    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:11.823293 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:11.823162    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:11.823293 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:11.823253    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:13.818993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:13.818929    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:13.818993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:13.818945    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:13.819784 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:13.819065    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:39:13.819784 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:13.819131    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zdjh9" podUID="c3764482-65ef-4753-aaab-f03fb5a05113"
Jun 11 23:39:13.819784 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:13.819196    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:13.819784 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:13.819312    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxqhp" podUID="4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e"
Jun 11 23:39:15.625999 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.625841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:15.626360 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.626023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:15.626360 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.625975    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 11 23:39:15.626360 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.626103    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:39:15.626360 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.626125    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret podName:4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e nodeName:}" failed. No retries permitted until 2026-06-11 23:39:47.626108179 +0000 UTC m=+66.251181390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret") pod "global-pull-secret-syncer-jxqhp" (UID: "4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e") : object "kube-system"/"original-pull-secret" not registered
Jun 11 23:39:15.626360 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.626141    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:39:47.626133736 +0000 UTC m=+66.251206947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 11 23:39:15.700359 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.700319    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-3.ec2.internal" event="NodeReady"
Jun 11 23:39:15.700481 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.700466    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 11 23:39:15.727211 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.727191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:15.727358 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.727346    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 11 23:39:15.727428 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.727368    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 11 23:39:15.727428 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.727379    2575 projected.go:196] Error preparing data for projected volume kube-api-access-xdnlg for pod openshift-network-diagnostics/network-check-target-zdjh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:39:15.727527 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:15.727437    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg podName:c3764482-65ef-4753-aaab-f03fb5a05113 nodeName:}" failed. No retries permitted until 2026-06-11 23:39:47.727416655 +0000 UTC m=+66.352489885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xdnlg" (UniqueName: "kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg") pod "network-check-target-zdjh9" (UID: "c3764482-65ef-4753-aaab-f03fb5a05113") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 11 23:39:15.743202 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.743152    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wnxwr"]
Jun 11 23:39:15.762057 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.762037    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gpw5k"]
Jun 11 23:39:15.762169 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.762154    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:15.764977 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.764953    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 11 23:39:15.765082 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.764993    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 11 23:39:15.765171 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.765092    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkcbb\""
Jun 11 23:39:15.772268 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.772252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wnxwr"]
Jun 11 23:39:15.772354 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.772282    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpw5k"]
Jun 11 23:39:15.772396 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.772364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:15.776640 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.774911    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 11 23:39:15.776640 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.776116    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f4r6w\""
Jun 11 23:39:15.776640 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.776437    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 11 23:39:15.776640 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.776551    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 11 23:39:15.818702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.818676    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:15.818793 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.818681    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:15.818853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.818686    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:15.821441 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.821424    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 23:39:15.821537 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.821425    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 23:39:15.821599 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.821539    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqccd\""
Jun 11 23:39:15.821794 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.821775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hwkl\""
Jun 11 23:39:15.821876 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.821856    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 23:39:15.821980 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.821955    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 23:39:15.928605 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.928577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c14c4c-a784-488b-a05b-f433997ff9aa-tmp-dir\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:15.928728 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.928620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:15.928728 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.928636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nt6n\" (UniqueName: \"kubernetes.io/projected/68c14c4c-a784-488b-a05b-f433997ff9aa-kube-api-access-2nt6n\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:15.928728 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.928703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8bde608-1875-4b39-8290-36a12dd3606a-cert\") pod \"ingress-canary-gpw5k\" (UID: \"f8bde608-1875-4b39-8290-36a12dd3606a\") " pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:15.928888 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.928778    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfbk\" (UniqueName: \"kubernetes.io/projected/f8bde608-1875-4b39-8290-36a12dd3606a-kube-api-access-dtfbk\") pod \"ingress-canary-gpw5k\" (UID: \"f8bde608-1875-4b39-8290-36a12dd3606a\") " pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:15.928888 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.928847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68c14c4c-a784-488b-a05b-f433997ff9aa-config-volume\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:15.964861 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.964833    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0c8f0e-52ba-442b-8872-20b6387842f9" containerID="f613356128fbff92a578b2c419f9c832760a0fa051856c89d1b3ccbac7b81781" exitCode=0
Jun 11 23:39:15.964940 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:15.964883    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerDied","Data":"f613356128fbff92a578b2c419f9c832760a0fa051856c89d1b3ccbac7b81781"}
Jun 11 23:39:16.029615 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.029590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c14c4c-a784-488b-a05b-f433997ff9aa-tmp-dir\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.029745 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.029644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.029745 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.029669    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nt6n\" (UniqueName: \"kubernetes.io/projected/68c14c4c-a784-488b-a05b-f433997ff9aa-kube-api-access-2nt6n\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.029745 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.029710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8bde608-1875-4b39-8290-36a12dd3606a-cert\") pod \"ingress-canary-gpw5k\" (UID: \"f8bde608-1875-4b39-8290-36a12dd3606a\") " pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:16.029903 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:16.029809    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:16.029903 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:16.029861    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:39:16.529844707 +0000 UTC m=+35.154917939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:16.030010 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.029960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfbk\" (UniqueName: \"kubernetes.io/projected/f8bde608-1875-4b39-8290-36a12dd3606a-kube-api-access-dtfbk\") pod \"ingress-canary-gpw5k\" (UID: \"f8bde608-1875-4b39-8290-36a12dd3606a\") " pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:16.030063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.030020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68c14c4c-a784-488b-a05b-f433997ff9aa-config-volume\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.030203 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.029960    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c14c4c-a784-488b-a05b-f433997ff9aa-tmp-dir\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.030543 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.030522    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68c14c4c-a784-488b-a05b-f433997ff9aa-config-volume\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.034697 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.034672    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8bde608-1875-4b39-8290-36a12dd3606a-cert\") pod \"ingress-canary-gpw5k\" (UID: \"f8bde608-1875-4b39-8290-36a12dd3606a\") " pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:16.040833 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.040800    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nt6n\" (UniqueName: \"kubernetes.io/projected/68c14c4c-a784-488b-a05b-f433997ff9aa-kube-api-access-2nt6n\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.041304 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.041287    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfbk\" (UniqueName: \"kubernetes.io/projected/f8bde608-1875-4b39-8290-36a12dd3606a-kube-api-access-dtfbk\") pod \"ingress-canary-gpw5k\" (UID: \"f8bde608-1875-4b39-8290-36a12dd3606a\") " pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:16.082099 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.082077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpw5k"
Jun 11 23:39:16.261057 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.261000    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpw5k"]
Jun 11 23:39:16.264566 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:39:16.264544    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bde608_1875_4b39_8290_36a12dd3606a.slice/crio-9d2add79c128cc3449d370a93f074efaa6eebff8647f7cc274f1dbd0ab0dd413 WatchSource:0}: Error finding container 9d2add79c128cc3449d370a93f074efaa6eebff8647f7cc274f1dbd0ab0dd413: Status 404 returned error can't find the container with id 9d2add79c128cc3449d370a93f074efaa6eebff8647f7cc274f1dbd0ab0dd413
Jun 11 23:39:16.532532 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.532465    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:16.532645 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:16.532612    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:16.532683 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:16.532673    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:39:17.532657502 +0000 UTC m=+36.157730714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:16.970394 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.970357    2575 generic.go:356] "Generic (PLEG): container finished" podID="4f0c8f0e-52ba-442b-8872-20b6387842f9" containerID="d290b4a28013f9fe0be47a7a637538f10a1732e091b4409984d235411fb18c0c" exitCode=0
Jun 11 23:39:16.970866 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.970446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerDied","Data":"d290b4a28013f9fe0be47a7a637538f10a1732e091b4409984d235411fb18c0c"}
Jun 11 23:39:16.971672 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:16.971617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpw5k" event={"ID":"f8bde608-1875-4b39-8290-36a12dd3606a","Type":"ContainerStarted","Data":"9d2add79c128cc3449d370a93f074efaa6eebff8647f7cc274f1dbd0ab0dd413"}
Jun 11 23:39:17.542185 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:17.541977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:17.542455 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:17.542145    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:17.542455 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:17.542321    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:39:19.542304007 +0000 UTC m=+38.167377231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:17.976779 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:17.976747    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92lbx" event={"ID":"4f0c8f0e-52ba-442b-8872-20b6387842f9","Type":"ContainerStarted","Data":"6cb17ca004408fd1d6b59afc05c532bdd66b0187ed4630b9b6bd2ba24feccf12"}
Jun 11 23:39:17.999939 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:17.999891    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-92lbx" podStartSLOduration=8.481894004 podStartE2EDuration="35.999876614s" totalImagesPullingTime="27.51798261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:17.997886352 +0000 UTC m=+36.622959584" watchObservedRunningTime="2026-06-11 23:39:17.999876614 +0000 UTC m=+36.624949846"
Jun 11 23:39:18.980687 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:18.980652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpw5k" event={"ID":"f8bde608-1875-4b39-8290-36a12dd3606a","Type":"ContainerStarted","Data":"93dff99050d3785e54592be87e56087deaf6a3f42d4ed519f8cdbda2bd15a997"}
Jun 11 23:39:18.995877 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:18.995834    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gpw5k" podStartSLOduration=2.070523127 podStartE2EDuration="3.995819196s" totalImagesPullingTime="1.925296069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:18.995232782 +0000 UTC m=+37.620306016" watchObservedRunningTime="2026-06-11 23:39:18.995819196 +0000 UTC m=+37.620892458"
Jun 11 23:39:19.556114 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:19.556083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:19.556263 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:19.556213    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:19.556309 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:19.556274    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:39:23.5562584 +0000 UTC m=+42.181331610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:23.578239 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:23.578207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:23.578650 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:23.578359    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:23.578650 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:23.578423    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:39:31.578406735 +0000 UTC m=+50.203479946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:31.628277 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:31.628242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:31.628680 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:31.628412    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:31.628680 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:31.628495    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:39:47.628471989 +0000 UTC m=+66.253545200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:41.964593 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:41.964568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtk6w"
Jun 11 23:39:47.633531 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.633498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:47.633904 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.633542    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:39:47.633904 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.633561    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:39:47.633904 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:47.633678    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:39:47.633904 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:47.633763    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:40:19.633743248 +0000 UTC m=+98.258816480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:39:47.636251 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.636231    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 11 23:39:47.636358 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.636285    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 11 23:39:47.644402 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:47.644386    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 23:39:47.644475 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:39:47.644438    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:40:51.644423249 +0000 UTC m=+130.269496463 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : secret "metrics-daemon-secret" not found
Jun 11 23:39:47.647739 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.647713    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e-original-pull-secret\") pod \"global-pull-secret-syncer-jxqhp\" (UID: \"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e\") " pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:47.734733 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.734707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:47.737661 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.737646    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 11 23:39:47.748097 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.748078    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 11 23:39:47.758455 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.758422    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdnlg\" (UniqueName: \"kubernetes.io/projected/c3764482-65ef-4753-aaab-f03fb5a05113-kube-api-access-xdnlg\") pod \"network-check-target-zdjh9\" (UID: \"c3764482-65ef-4753-aaab-f03fb5a05113\") " pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:47.935499 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.935441    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqccd\""
Jun 11 23:39:47.937548 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.937533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxqhp"
Jun 11 23:39:47.943924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:47.943900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:48.093540 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:48.093470    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxqhp"]
Jun 11 23:39:48.110132 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:48.110109    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zdjh9"]
Jun 11 23:39:48.112861 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:39:48.112836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3764482_65ef_4753_aaab_f03fb5a05113.slice/crio-901bdf712df4963501d3e375b22e38c061d1f4096891dfd724adb0bb99d3d240 WatchSource:0}: Error finding container 901bdf712df4963501d3e375b22e38c061d1f4096891dfd724adb0bb99d3d240: Status 404 returned error can't find the container with id 901bdf712df4963501d3e375b22e38c061d1f4096891dfd724adb0bb99d3d240
Jun 11 23:39:49.045955 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:49.045877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zdjh9" event={"ID":"c3764482-65ef-4753-aaab-f03fb5a05113","Type":"ContainerStarted","Data":"901bdf712df4963501d3e375b22e38c061d1f4096891dfd724adb0bb99d3d240"}
Jun 11 23:39:49.047383 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:49.047356    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxqhp" event={"ID":"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e","Type":"ContainerStarted","Data":"05b68b0761da68f86a56d07274d5a28d694c10d1e1850e1b266fb56a1714621e"}
Jun 11 23:39:53.059213 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:53.059118    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxqhp" event={"ID":"4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e","Type":"ContainerStarted","Data":"c8919e1c123685fc054841f54d0bfabe7dcc264057aeecf12a8f9901746f520f"}
Jun 11 23:39:53.060558 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:53.060533    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zdjh9" event={"ID":"c3764482-65ef-4753-aaab-f03fb5a05113","Type":"ContainerStarted","Data":"6b69899348a566279620c78a8c424869f5f42eb60bd3cab2b4331a169473d49b"}
Jun 11 23:39:53.060687 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:53.060672    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:39:53.073977 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:53.073933    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jxqhp" podStartSLOduration=66.438437586 podStartE2EDuration="1m11.073918517s" totalImagesPullingTime="4.635480931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:53.073431245 +0000 UTC m=+71.698504488" watchObservedRunningTime="2026-06-11 23:39:53.073918517 +0000 UTC m=+71.698991751"
Jun 11 23:39:53.087630 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:53.087589    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zdjh9" podStartSLOduration=67.471361466 podStartE2EDuration="1m12.087574776s" totalImagesPullingTime="4.61621331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:39:53.087524799 +0000 UTC m=+71.712598034" watchObservedRunningTime="2026-06-11 23:39:53.087574776 +0000 UTC m=+71.712648010"
Jun 11 23:39:56.808520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.808485    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"]
Jun 11 23:39:56.810066 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.810050    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:56.812591 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.812567    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 11 23:39:56.812708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.812594    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 11 23:39:56.813974 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.813957    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 11 23:39:56.814053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.814011    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 11 23:39:56.814053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.814014    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fgjv5\""
Jun 11 23:39:56.822211 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.822192    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"]
Jun 11 23:39:56.897521 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.897496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1308797-12c7-4ce7-9a46-875ba900eee7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7\" (UID: \"c1308797-12c7-4ce7-9a46-875ba900eee7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:56.897627 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.897538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq4w6\" (UniqueName: \"kubernetes.io/projected/c1308797-12c7-4ce7-9a46-875ba900eee7-kube-api-access-gq4w6\") pod \"managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7\" (UID: \"c1308797-12c7-4ce7-9a46-875ba900eee7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:56.997949 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.997907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq4w6\" (UniqueName: \"kubernetes.io/projected/c1308797-12c7-4ce7-9a46-875ba900eee7-kube-api-access-gq4w6\") pod \"managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7\" (UID: \"c1308797-12c7-4ce7-9a46-875ba900eee7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:56.998076 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:56.998059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1308797-12c7-4ce7-9a46-875ba900eee7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7\" (UID: \"c1308797-12c7-4ce7-9a46-875ba900eee7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:57.000460 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:57.000433    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1308797-12c7-4ce7-9a46-875ba900eee7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7\" (UID: \"c1308797-12c7-4ce7-9a46-875ba900eee7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:57.006191 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:57.006171    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq4w6\" (UniqueName: \"kubernetes.io/projected/c1308797-12c7-4ce7-9a46-875ba900eee7-kube-api-access-gq4w6\") pod \"managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7\" (UID: \"c1308797-12c7-4ce7-9a46-875ba900eee7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:57.131951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:57.131857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"
Jun 11 23:39:57.250269 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:57.250240    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7"]
Jun 11 23:39:57.253181 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:39:57.253145    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1308797_12c7_4ce7_9a46_875ba900eee7.slice/crio-5fdddc51a939894c2994c369e41fb94d689d56e64ce6436d596c095397d6b916 WatchSource:0}: Error finding container 5fdddc51a939894c2994c369e41fb94d689d56e64ce6436d596c095397d6b916: Status 404 returned error can't find the container with id 5fdddc51a939894c2994c369e41fb94d689d56e64ce6436d596c095397d6b916
Jun 11 23:39:58.074153 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:39:58.074085    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7" event={"ID":"c1308797-12c7-4ce7-9a46-875ba900eee7","Type":"ContainerStarted","Data":"5fdddc51a939894c2994c369e41fb94d689d56e64ce6436d596c095397d6b916"}
Jun 11 23:40:00.080198 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:40:00.080161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7" event={"ID":"c1308797-12c7-4ce7-9a46-875ba900eee7","Type":"ContainerStarted","Data":"d5bd7b31b2a4735a07d4646b32e4f02d31ebe10ee6f331914d93981e4aa28d7c"}
Jun 11 23:40:00.094209 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:40:00.094168    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7" podStartSLOduration=1.739598232 podStartE2EDuration="4.094155541s" totalImagesPullingTime="2.354557309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:40:00.094118139 +0000 UTC m=+78.719191371" watchObservedRunningTime="2026-06-11 23:40:00.094155541 +0000 UTC m=+78.719228816"
Jun 11 23:40:19.645493 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:40:19.645457    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:40:19.645792 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:40:19.645607    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:40:19.645792 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:40:19.645681    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:41:23.645664492 +0000 UTC m=+162.270737703 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:40:24.064544 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:40:24.064511    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zdjh9"
Jun 11 23:40:51.740889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:40:51.740842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:40:51.741286 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:40:51.740987    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 23:40:51.741286 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:40:51.741062    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:53.741044558 +0000 UTC m=+252.366117770 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : secret "metrics-daemon-secret" not found
Jun 11 23:41:18.770535 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:41:18.770498    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wnxwr" podUID="68c14c4c-a784-488b-a05b-f433997ff9aa"
Jun 11 23:41:18.827780 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:41:18.827756    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:41:19.258687 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:41:19.258664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:41:23.739022 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:41:23.738987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:41:23.739430 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:41:23.739138    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 11 23:41:23.739430 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:41:23.739233    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls podName:68c14c4c-a784-488b-a05b-f433997ff9aa nodeName:}" failed. No retries permitted until 2026-06-11 23:43:25.739218883 +0000 UTC m=+284.364292093 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls") pod "dns-default-wnxwr" (UID: "68c14c4c-a784-488b-a05b-f433997ff9aa") : secret "dns-default-metrics-tls" not found
Jun 11 23:41:29.819276 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:41:29.819243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:42:00.354483 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:00.354452    2575 generic.go:356] "Generic (PLEG): container finished" podID="c1308797-12c7-4ce7-9a46-875ba900eee7" containerID="d5bd7b31b2a4735a07d4646b32e4f02d31ebe10ee6f331914d93981e4aa28d7c" exitCode=255
Jun 11 23:42:00.354856 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:00.354513    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7" event={"ID":"c1308797-12c7-4ce7-9a46-875ba900eee7","Type":"ContainerDied","Data":"d5bd7b31b2a4735a07d4646b32e4f02d31ebe10ee6f331914d93981e4aa28d7c"}
Jun 11 23:42:00.359999 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:00.359983    2575 scope.go:117] "RemoveContainer" containerID="d5bd7b31b2a4735a07d4646b32e4f02d31ebe10ee6f331914d93981e4aa28d7c"
Jun 11 23:42:01.358482 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:01.358452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7fb7cc486b-cjvv7" event={"ID":"c1308797-12c7-4ce7-9a46-875ba900eee7","Type":"ContainerStarted","Data":"39be3e974fd330e78e9474597035d999064eafe794a90474f98eecf8b9f4920e"}
Jun 11 23:42:36.349546 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.349515    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"]
Jun 11 23:42:36.352400 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.352383    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.353855 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.353831    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"]
Jun 11 23:42:36.356528 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.356504    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.356942 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.356923    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 11 23:42:36.356942 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.356941    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 11 23:42:36.360083 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.359882    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-phm47\""
Jun 11 23:42:36.360083 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.359898    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 11 23:42:36.360083 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.359967    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 11 23:42:36.360083 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.360041    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 11 23:42:36.360263 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.360123    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 11 23:42:36.360263 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.360251    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2k2nl\""
Jun 11 23:42:36.360363 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.360291    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 11 23:42:36.360363 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.360348    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 11 23:42:36.360978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.360955    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-bfc5w"]
Jun 11 23:42:36.363577 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.363559    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.366447 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.366431    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 11 23:42:36.366706 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.366694    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 11 23:42:36.366785 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.366770    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 11 23:42:36.366844 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.366793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 11 23:42:36.369761 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.369747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7fs8t\""
Jun 11 23:42:36.372033 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.372014    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"]
Jun 11 23:42:36.372994 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.372974    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"]
Jun 11 23:42:36.376612 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.376595    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 11 23:42:36.383460 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.383443    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-bfc5w"]
Jun 11 23:42:36.457643 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.457623    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"]
Jun 11 23:42:36.460518 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.460500    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"]
Jun 11 23:42:36.460633 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.460617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"
Jun 11 23:42:36.462984 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.462969    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69d57fc9d6-56v69"]
Jun 11 23:42:36.463083 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.463071    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"
Jun 11 23:42:36.463475 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.463461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jzvvp\""
Jun 11 23:42:36.465608 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.465593    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-644fcfc5b4-wgrd5"]
Jun 11 23:42:36.465725 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.465712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.466693 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.466544    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 11 23:42:36.466693 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.466584    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 11 23:42:36.466850 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.466702    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qmkj4\""
Jun 11 23:42:36.468275 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.468260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.468579 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.468563    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 11 23:42:36.468670 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.468568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qkgxc\""
Jun 11 23:42:36.468670 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.468568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 11 23:42:36.468951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.468938    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 11 23:42:36.470291 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.470274    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 11 23:42:36.470397 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.470368    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 11 23:42:36.470770 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.470758    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 11 23:42:36.471921 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.471905    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 11 23:42:36.472015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.471925    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 11 23:42:36.472015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.471908    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h6777\""
Jun 11 23:42:36.472015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.471958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 11 23:42:36.477784 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.477767    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"]
Jun 11 23:42:36.479077 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.479058    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 11 23:42:36.481470 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.481451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"]
Jun 11 23:42:36.501010 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.500987    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.501093 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.501093 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.501093 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-serving-cert\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.501219 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6n26\" (UniqueName: \"kubernetes.io/projected/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-kube-api-access-h6n26\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.501219 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxglv\" (UniqueName: \"kubernetes.io/projected/dd833a57-64b0-4eb9-922c-a51f1bd61190-kube-api-access-fxglv\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.501219 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501162    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dd833a57-64b0-4eb9-922c-a51f1bd61190-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.501219 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm255\" (UniqueName: \"kubernetes.io/projected/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-kube-api-access-jm255\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.501219 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-config\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.501488 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.501223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-trusted-ca\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.503255 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.503237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d57fc9d6-56v69"]
Jun 11 23:42:36.531090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.531070    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644fcfc5b4-wgrd5"]
Jun 11 23:42:36.551534 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.551511    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"]
Jun 11 23:42:36.554356 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.554323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.557056 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.557040    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jun 11 23:42:36.557352 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.557322    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cjgxs\""
Jun 11 23:42:36.557352 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.557348    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jun 11 23:42:36.557498 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.557390    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jun 11 23:42:36.557498 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.557344    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jun 11 23:42:36.565897 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.565874    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"]
Jun 11 23:42:36.601832 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.601773    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n26\" (UniqueName: \"kubernetes.io/projected/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-kube-api-access-h6n26\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.601832 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.601820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-certificates\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.601953 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.601839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-config\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.601953 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.601854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.601953 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.601877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-installation-pull-secrets\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.601953 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.601895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-trusted-ca\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.602158 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602007    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.602158 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-trusted-ca\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.602158 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcmd4\" (UniqueName: \"kubernetes.io/projected/b2e24e83-c8ce-44de-94be-66a420d5611b-kube-api-access-wcmd4\") pod \"volume-data-source-validator-bd4ccd799-t9rsm\" (UID: \"b2e24e83-c8ce-44de-94be-66a420d5611b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"
Jun 11 23:42:36.602158 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-stats-auth\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.602158 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxglv\" (UniqueName: \"kubernetes.io/projected/dd833a57-64b0-4eb9-922c-a51f1bd61190-kube-api-access-fxglv\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4kb\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-kube-api-access-vv4kb\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dd833a57-64b0-4eb9-922c-a51f1bd61190-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm255\" (UniqueName: \"kubernetes.io/projected/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-kube-api-access-jm255\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhjlc\" (UniqueName: \"kubernetes.io/projected/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-kube-api-access-jhjlc\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-bound-sa-token\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602303    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-image-registry-private-configuration\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92a0cef3-838f-48d4-a42a-ef106ba9dceb-ca-trust-extracted\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.602479 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602458    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6f2z\" (UniqueName: \"kubernetes.io/projected/5be13a02-5e1a-4d09-bbfd-7e6edae0ab16-kube-api-access-h6f2z\") pod \"network-check-source-6947749cfc-2gj8s\" (UID: \"5be13a02-5e1a-4d09-bbfd-7e6edae0ab16\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-config\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602557    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-serving-cert\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602601    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-default-certificate\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.602772    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.602853    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls podName:dd833a57-64b0-4eb9-922c-a51f1bd61190 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:37.102832919 +0000 UTC m=+235.727906145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-cgm6g" (UID: "dd833a57-64b0-4eb9-922c-a51f1bd61190") : secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:36.602924 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602858    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-trusted-ca\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.603233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.602972    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dd833a57-64b0-4eb9-922c-a51f1bd61190-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.603233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.603046    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.604316 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.604297    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.604763 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.604742    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-serving-cert\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.611583 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.611560    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxglv\" (UniqueName: \"kubernetes.io/projected/dd833a57-64b0-4eb9-922c-a51f1bd61190-kube-api-access-fxglv\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:36.611978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.611955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm255\" (UniqueName: \"kubernetes.io/projected/838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a-kube-api-access-jm255\") pod \"kube-storage-version-migrator-operator-7c578b78fc-7wtv2\" (UID: \"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.612492 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.612470    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6n26\" (UniqueName: \"kubernetes.io/projected/cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b-kube-api-access-h6n26\") pod \"console-operator-5dbbb5d744-bfc5w\" (UID: \"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b\") " pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.668547 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.668525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"
Jun 11 23:42:36.674612 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.674592    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:36.703258 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703226    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-certificates\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.703258 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703263    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-installation-pull-secrets\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c289g\" (UniqueName: \"kubernetes.io/projected/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-kube-api-access-c289g\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.703411    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703428    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-trusted-ca\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.703486    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:37.203464331 +0000 UTC m=+235.828537558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : secret "router-metrics-certs-default" not found
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcmd4\" (UniqueName: \"kubernetes.io/projected/b2e24e83-c8ce-44de-94be-66a420d5611b-kube-api-access-wcmd4\") pod \"volume-data-source-validator-bd4ccd799-t9rsm\" (UID: \"b2e24e83-c8ce-44de-94be-66a420d5611b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-stats-auth\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-config\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4kb\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-kube-api-access-vv4kb\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhjlc\" (UniqueName: \"kubernetes.io/projected/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-kube-api-access-jhjlc\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703709    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-bound-sa-token\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703746    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-certificates\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.704576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.703784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-image-registry-private-configuration\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.703987    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:37.20396787 +0000 UTC m=+235.829041099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : configmap references non-existent config key: service-ca.crt
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.703995    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.704012    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644fcfc5b4-wgrd5: secret "image-registry-tls" not found
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.704044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92a0cef3-838f-48d4-a42a-ef106ba9dceb-ca-trust-extracted\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:36.704067    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls podName:92a0cef3-838f-48d4-a42a-ef106ba9dceb nodeName:}" failed. No retries permitted until 2026-06-11 23:42:37.204051988 +0000 UTC m=+235.829125353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls") pod "image-registry-644fcfc5b4-wgrd5" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb") : secret "image-registry-tls" not found
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.704099    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6f2z\" (UniqueName: \"kubernetes.io/projected/5be13a02-5e1a-4d09-bbfd-7e6edae0ab16-kube-api-access-h6f2z\") pod \"network-check-source-6947749cfc-2gj8s\" (UID: \"5be13a02-5e1a-4d09-bbfd-7e6edae0ab16\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.704259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-default-certificate\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.704409    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92a0cef3-838f-48d4-a42a-ef106ba9dceb-ca-trust-extracted\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.705838 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.704507    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-trusted-ca\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.706424 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.706181    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-installation-pull-secrets\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.706424 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.706270    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-stats-auth\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.706742 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.706723    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-image-registry-private-configuration\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.707003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.706974    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-default-certificate\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.713950 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.712818    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-bound-sa-token\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.713950 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.713896    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4kb\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-kube-api-access-vv4kb\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:36.714114 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.714011    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcmd4\" (UniqueName: \"kubernetes.io/projected/b2e24e83-c8ce-44de-94be-66a420d5611b-kube-api-access-wcmd4\") pod \"volume-data-source-validator-bd4ccd799-t9rsm\" (UID: \"b2e24e83-c8ce-44de-94be-66a420d5611b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"
Jun 11 23:42:36.714471 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.714449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhjlc\" (UniqueName: \"kubernetes.io/projected/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-kube-api-access-jhjlc\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:36.714944 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.714923    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6f2z\" (UniqueName: \"kubernetes.io/projected/5be13a02-5e1a-4d09-bbfd-7e6edae0ab16-kube-api-access-h6f2z\") pod \"network-check-source-6947749cfc-2gj8s\" (UID: \"5be13a02-5e1a-4d09-bbfd-7e6edae0ab16\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"
Jun 11 23:42:36.770602 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.770571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"
Jun 11 23:42:36.775699 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.775679    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"
Jun 11 23:42:36.799043 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.799017    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2"]
Jun 11 23:42:36.801001 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:42:36.800953    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838a3ba8_6d5e_4ab1_8d74_d198eb2ab77a.slice/crio-c3f2d98eaf967e821bde49a3f13ebe3affb4cecc8c76662fd9fc6c1c988aa683 WatchSource:0}: Error finding container c3f2d98eaf967e821bde49a3f13ebe3affb4cecc8c76662fd9fc6c1c988aa683: Status 404 returned error can't find the container with id c3f2d98eaf967e821bde49a3f13ebe3affb4cecc8c76662fd9fc6c1c988aa683
Jun 11 23:42:36.804668 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.804640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c289g\" (UniqueName: \"kubernetes.io/projected/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-kube-api-access-c289g\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.804794 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.804717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.804794 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.804748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-config\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.805326 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.805304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-config\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.807208 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.807161    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.815279 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.815238    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-bfc5w"]
Jun 11 23:42:36.817527 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.817478    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c289g\" (UniqueName: \"kubernetes.io/projected/2c006d1a-f1fb-40e5-b91a-b5aca8d0118c-kube-api-access-c289g\") pod \"service-ca-operator-7ccbfd59dc-gdlll\" (UID: \"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.818213 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:42:36.818192    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb48ef7e_7d0c_4393_84c9_5a3c507a4d3b.slice/crio-34b284cdc92c5b2d840348c366002cb0a70a1ef00ce6b042a54d0343d006561a WatchSource:0}: Error finding container 34b284cdc92c5b2d840348c366002cb0a70a1ef00ce6b042a54d0343d006561a: Status 404 returned error can't find the container with id 34b284cdc92c5b2d840348c366002cb0a70a1ef00ce6b042a54d0343d006561a
Jun 11 23:42:36.862613 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.862590    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"
Jun 11 23:42:36.905914 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.905875    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s"]
Jun 11 23:42:36.908910 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:42:36.908875    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be13a02_5e1a_4d09_bbfd_7e6edae0ab16.slice/crio-b84f67267f40de0fdf1f4b3d2d8cae8070e502b57eeabafa7ce2a9ae2b41a9ce WatchSource:0}: Error finding container b84f67267f40de0fdf1f4b3d2d8cae8070e502b57eeabafa7ce2a9ae2b41a9ce: Status 404 returned error can't find the container with id b84f67267f40de0fdf1f4b3d2d8cae8070e502b57eeabafa7ce2a9ae2b41a9ce
Jun 11 23:42:36.924388 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.924366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm"]
Jun 11 23:42:36.926795 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:42:36.926762    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e24e83_c8ce_44de_94be_66a420d5611b.slice/crio-12c22b9ee462818eca0ec87d4bd3bf809bcab48d159f80e370c4024b2c5dfd8d WatchSource:0}: Error finding container 12c22b9ee462818eca0ec87d4bd3bf809bcab48d159f80e370c4024b2c5dfd8d: Status 404 returned error can't find the container with id 12c22b9ee462818eca0ec87d4bd3bf809bcab48d159f80e370c4024b2c5dfd8d
Jun 11 23:42:36.990685 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:36.990658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll"]
Jun 11 23:42:36.994133 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:42:36.994092    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c006d1a_f1fb_40e5_b91a_b5aca8d0118c.slice/crio-f3542afde785898816acfa8257370dbbd1cf823942f192cf47b94a5d05eb96ed WatchSource:0}: Error finding container f3542afde785898816acfa8257370dbbd1cf823942f192cf47b94a5d05eb96ed: Status 404 returned error can't find the container with id f3542afde785898816acfa8257370dbbd1cf823942f192cf47b94a5d05eb96ed
Jun 11 23:42:37.107636 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.107566    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:37.107748 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.107710    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:37.107790 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.107768    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls podName:dd833a57-64b0-4eb9-922c-a51f1bd61190 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:38.107752893 +0000 UTC m=+236.732826104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-cgm6g" (UID: "dd833a57-64b0-4eb9-922c-a51f1bd61190") : secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:37.208028 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.208000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:37.208171 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.208033    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:37.208171 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.208132    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 23:42:37.208171 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.208142    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644fcfc5b4-wgrd5: secret "image-registry-tls" not found
Jun 11 23:42:37.208322 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.208169    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:38.208149259 +0000 UTC m=+236.833222477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : configmap references non-existent config key: service-ca.crt
Jun 11 23:42:37.208322 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.208199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:37.208322 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.208281    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls podName:92a0cef3-838f-48d4-a42a-ef106ba9dceb nodeName:}" failed. No retries permitted until 2026-06-11 23:42:38.208269134 +0000 UTC m=+236.833342344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls") pod "image-registry-644fcfc5b4-wgrd5" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb") : secret "image-registry-tls" not found
Jun 11 23:42:37.208322 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.208299    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 11 23:42:37.208488 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:37.208372    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:38.208354175 +0000 UTC m=+236.833427402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : secret "router-metrics-certs-default" not found
Jun 11 23:42:37.456685 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.456601    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm" event={"ID":"b2e24e83-c8ce-44de-94be-66a420d5611b","Type":"ContainerStarted","Data":"12c22b9ee462818eca0ec87d4bd3bf809bcab48d159f80e370c4024b2c5dfd8d"}
Jun 11 23:42:37.458236 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.458178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll" event={"ID":"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c","Type":"ContainerStarted","Data":"f3542afde785898816acfa8257370dbbd1cf823942f192cf47b94a5d05eb96ed"}
Jun 11 23:42:37.460016 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.459964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" event={"ID":"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b","Type":"ContainerStarted","Data":"34b284cdc92c5b2d840348c366002cb0a70a1ef00ce6b042a54d0343d006561a"}
Jun 11 23:42:37.461274 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.461220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2" event={"ID":"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a","Type":"ContainerStarted","Data":"c3f2d98eaf967e821bde49a3f13ebe3affb4cecc8c76662fd9fc6c1c988aa683"}
Jun 11 23:42:37.463291 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.463269    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s" event={"ID":"5be13a02-5e1a-4d09-bbfd-7e6edae0ab16","Type":"ContainerStarted","Data":"86b3b571970bf7edd8723d260e592bfd174ef84fb94fc1076bd7b1971772c67e"}
Jun 11 23:42:37.463399 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.463307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s" event={"ID":"5be13a02-5e1a-4d09-bbfd-7e6edae0ab16","Type":"ContainerStarted","Data":"b84f67267f40de0fdf1f4b3d2d8cae8070e502b57eeabafa7ce2a9ae2b41a9ce"}
Jun 11 23:42:37.480966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:37.480917    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-2gj8s" podStartSLOduration=1.480899759 podStartE2EDuration="1.480899759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:37.479850223 +0000 UTC m=+236.104923458" watchObservedRunningTime="2026-06-11 23:42:37.480899759 +0000 UTC m=+236.105972993"
Jun 11 23:42:38.116901 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:38.116861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:38.117094 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.117005    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:38.117094 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.117068    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls podName:dd833a57-64b0-4eb9-922c-a51f1bd61190 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:40.117049873 +0000 UTC m=+238.742123105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-cgm6g" (UID: "dd833a57-64b0-4eb9-922c-a51f1bd61190") : secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:38.217611 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:38.217569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:38.217787 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:38.217681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:38.217787 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:38.217708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:38.217787 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.217730    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 11 23:42:38.217951 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.217804    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:40.217784877 +0000 UTC m=+238.842858097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : secret "router-metrics-certs-default" not found
Jun 11 23:42:38.217951 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.217842    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 23:42:38.217951 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.217856    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644fcfc5b4-wgrd5: secret "image-registry-tls" not found
Jun 11 23:42:38.217951 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.217903    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls podName:92a0cef3-838f-48d4-a42a-ef106ba9dceb nodeName:}" failed. No retries permitted until 2026-06-11 23:42:40.217888621 +0000 UTC m=+238.842961835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls") pod "image-registry-644fcfc5b4-wgrd5" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb") : secret "image-registry-tls" not found
Jun 11 23:42:38.218251 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:38.217973    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:40.217963021 +0000 UTC m=+238.843036238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : configmap references non-existent config key: service-ca.crt
Jun 11 23:42:38.470644 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:38.470575    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm" event={"ID":"b2e24e83-c8ce-44de-94be-66a420d5611b","Type":"ContainerStarted","Data":"15dd330bd8acbc7202b55af57749e767380f8beb8f3c5e31d3824cf3de8c421e"}
Jun 11 23:42:38.489400 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:38.489326    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-t9rsm" podStartSLOduration=1.07807572 podStartE2EDuration="2.489307678s" totalImagesPullingTime="1.411231958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:38.487623877 +0000 UTC m=+237.112697111" watchObservedRunningTime="2026-06-11 23:42:38.489307678 +0000 UTC m=+237.114380915"
Jun 11 23:42:39.781512 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.781452    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-djwv4"]
Jun 11 23:42:39.786064 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.786040    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.788700 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.788676    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 11 23:42:39.788700 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.788693    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 11 23:42:39.789951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.789926    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 11 23:42:39.790063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.789930    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 11 23:42:39.790063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.789932    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skbjq\""
Jun 11 23:42:39.799206 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.799187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-djwv4"]
Jun 11 23:42:39.833922 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.833891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.834057 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.833943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f5db294-aa74-4d26-8753-0c17a23aaba2-crio-socket\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.834057 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.833968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f5db294-aa74-4d26-8753-0c17a23aaba2-data-volume\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.834057 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.833996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.834177 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.834066    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmg4s\" (UniqueName: \"kubernetes.io/projected/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-api-access-nmg4s\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935047 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935219 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmg4s\" (UniqueName: \"kubernetes.io/projected/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-api-access-nmg4s\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935219 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:39.935133    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:39.935219 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:39.935193    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:40.435174948 +0000 UTC m=+239.060248179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:39.935370 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935370 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935277    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f5db294-aa74-4d26-8753-0c17a23aaba2-crio-socket\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935370 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935296    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f5db294-aa74-4d26-8753-0c17a23aaba2-data-volume\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935523 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:39.935374    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 23:42:39.935523 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935410    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0f5db294-aa74-4d26-8753-0c17a23aaba2-crio-socket\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.935523 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:39.935421    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:40.435405931 +0000 UTC m=+239.060479157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : configmap "kube-rbac-proxy" not found
Jun 11 23:42:39.935650 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.935628    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f5db294-aa74-4d26-8753-0c17a23aaba2-data-volume\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:39.945401 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:39.945376    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmg4s\" (UniqueName: \"kubernetes.io/projected/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-api-access-nmg4s\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:40.137561 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.137483    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:40.137709 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.137630    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:40.137709 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.137702    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls podName:dd833a57-64b0-4eb9-922c-a51f1bd61190 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:44.137687184 +0000 UTC m=+242.762760396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-cgm6g" (UID: "dd833a57-64b0-4eb9-922c-a51f1bd61190") : secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:40.237916 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.237892    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:40.238032 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.237984    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:40.238032 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.238009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:40.238150 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.238035    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 11 23:42:40.238150 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.238090    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:44.238073457 +0000 UTC m=+242.863146677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : secret "router-metrics-certs-default" not found
Jun 11 23:42:40.238150 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.238125    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 23:42:40.238150 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.238138    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644fcfc5b4-wgrd5: secret "image-registry-tls" not found
Jun 11 23:42:40.238361 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.238150    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:44.238130796 +0000 UTC m=+242.863204021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : configmap references non-existent config key: service-ca.crt
Jun 11 23:42:40.238361 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.238174    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls podName:92a0cef3-838f-48d4-a42a-ef106ba9dceb nodeName:}" failed. No retries permitted until 2026-06-11 23:42:44.23816296 +0000 UTC m=+242.863236185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls") pod "image-registry-644fcfc5b4-wgrd5" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb") : secret "image-registry-tls" not found
Jun 11 23:42:40.440215 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.440159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:40.440215 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.440200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:40.440378 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.440294    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 23:42:40.440378 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.440345    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:40.440460 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.440383    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:41.440363215 +0000 UTC m=+240.065436441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : configmap "kube-rbac-proxy" not found
Jun 11 23:42:40.440460 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:40.440402    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:41.440392395 +0000 UTC m=+240.065465609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:40.478385 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.478357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll" event={"ID":"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c","Type":"ContainerStarted","Data":"713f154b6cddfae7a5cc25dae7861f3b761609cf50cf9dd1e9e554c480cb0d9d"}
Jun 11 23:42:40.479990 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.479971    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/0.log"
Jun 11 23:42:40.480098 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.480009    2575 generic.go:356] "Generic (PLEG): container finished" podID="cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b" containerID="a1eeaff5f29df383538eaf9b8fd858748374d26be4f347d3c25b4e978bd39f3e" exitCode=255
Jun 11 23:42:40.480161 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.480094    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" event={"ID":"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b","Type":"ContainerDied","Data":"a1eeaff5f29df383538eaf9b8fd858748374d26be4f347d3c25b4e978bd39f3e"}
Jun 11 23:42:40.480253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.480237    2575 scope.go:117] "RemoveContainer" containerID="a1eeaff5f29df383538eaf9b8fd858748374d26be4f347d3c25b4e978bd39f3e"
Jun 11 23:42:40.481687 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.481665    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2" event={"ID":"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a","Type":"ContainerStarted","Data":"59c9c0bdc678d1b49861213a770bcf4e196093d38aecbb2de06b9f9c18495b58"}
Jun 11 23:42:40.495342 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.495282    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll" podStartSLOduration=1.30661926 podStartE2EDuration="4.495265239s" totalImagesPullingTime="3.188645979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:40.494398359 +0000 UTC m=+239.119471591" watchObservedRunningTime="2026-06-11 23:42:40.495265239 +0000 UTC m=+239.120338477"
Jun 11 23:42:40.536801 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:40.536763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2" podStartSLOduration=1.158494585 podStartE2EDuration="4.536746049s" totalImagesPullingTime="3.378251464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:40.535549224 +0000 UTC m=+239.160622457" watchObservedRunningTime="2026-06-11 23:42:40.536746049 +0000 UTC m=+239.161819317"
Jun 11 23:42:41.448777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.448733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:41.448777 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.448778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:41.449311 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:41.448862    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 23:42:41.449311 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:41.448921    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:41.449311 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:41.448925    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:43.448909411 +0000 UTC m=+242.073982623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : configmap "kube-rbac-proxy" not found
Jun 11 23:42:41.449311 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:41.448977    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:43.448962427 +0000 UTC m=+242.074035638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:41.486019 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.485994    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:42:41.486373 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.486357    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/0.log"
Jun 11 23:42:41.486471 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.486395    2575 generic.go:356] "Generic (PLEG): container finished" podID="cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b" containerID="8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df" exitCode=255
Jun 11 23:42:41.486525 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.486486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" event={"ID":"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b","Type":"ContainerDied","Data":"8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df"}
Jun 11 23:42:41.486577 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.486539    2575 scope.go:117] "RemoveContainer" containerID="a1eeaff5f29df383538eaf9b8fd858748374d26be4f347d3c25b4e978bd39f3e"
Jun 11 23:42:41.486814 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.486798    2575 scope.go:117] "RemoveContainer" containerID="8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df"
Jun 11 23:42:41.486988 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:41.486968    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bfc5w_openshift-console-operator(cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" podUID="cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b"
Jun 11 23:42:41.948873 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:41.948845    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kkkdw_54d9ef40-4514-470d-9759-ea08e6fe0130/dns-node-resolver/0.log"
Jun 11 23:42:42.490752 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:42.490726    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:42:42.491135 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:42.491011    2575 scope.go:117] "RemoveContainer" containerID="8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df"
Jun 11 23:42:42.491195 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:42.491148    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bfc5w_openshift-console-operator(cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" podUID="cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b"
Jun 11 23:42:42.549644 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:42.549622    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-drf29_8c2df9da-e961-487f-8d73-ed899abe70a8/node-ca/0.log"
Jun 11 23:42:43.465122 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:43.465090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:43.465291 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:43.465137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:43.465291 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:43.465212    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 23:42:43.465291 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:43.465242    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:43.465291 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:43.465275    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:47.465259586 +0000 UTC m=+246.090332796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : configmap "kube-rbac-proxy" not found
Jun 11 23:42:43.465442 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:43.465297    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:47.465284644 +0000 UTC m=+246.090357869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:43.749711 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:43.749636    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpw5k_f8bde608-1875-4b39-8290-36a12dd3606a/serve-healthcheck-canary/0.log"
Jun 11 23:42:44.169292 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:44.169208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:44.169477 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.169375    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:44.169477 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.169444    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls podName:dd833a57-64b0-4eb9-922c-a51f1bd61190 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:52.169427148 +0000 UTC m=+250.794500374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-cgm6g" (UID: "dd833a57-64b0-4eb9-922c-a51f1bd61190") : secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:44.269907 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:44.269823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:44.270021 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.269920    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:52.269906293 +0000 UTC m=+250.894979504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : configmap references non-existent config key: service-ca.crt
Jun 11 23:42:44.270021 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:44.269940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:44.270021 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:44.269990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:44.270131 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.270097    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 11 23:42:44.270131 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.270100    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 11 23:42:44.270131 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.270115    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644fcfc5b4-wgrd5: secret "image-registry-tls" not found
Jun 11 23:42:44.270214 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.270136    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:52.270123171 +0000 UTC m=+250.895196401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : secret "router-metrics-certs-default" not found
Jun 11 23:42:44.270214 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:44.270148    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls podName:92a0cef3-838f-48d4-a42a-ef106ba9dceb nodeName:}" failed. No retries permitted until 2026-06-11 23:42:52.270142398 +0000 UTC m=+250.895215609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls") pod "image-registry-644fcfc5b4-wgrd5" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb") : secret "image-registry-tls" not found
Jun 11 23:42:46.675475 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:46.675403    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:46.675818 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:46.675476    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:46.675818 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:46.675735    2575 scope.go:117] "RemoveContainer" containerID="8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df"
Jun 11 23:42:46.675890 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:46.675874    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bfc5w_openshift-console-operator(cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" podUID="cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b"
Jun 11 23:42:47.493159 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:47.493128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:47.493352 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:47.493171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:47.493352 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:47.493250    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jun 11 23:42:47.493352 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:47.493269    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:47.493352 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:47.493310    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:55.493295929 +0000 UTC m=+254.118369140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : configmap "kube-rbac-proxy" not found
Jun 11 23:42:47.493352 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:47.493324    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:42:55.493318004 +0000 UTC m=+254.118391215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:47.505114 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:47.505094    2575 scope.go:117] "RemoveContainer" containerID="8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df"
Jun 11 23:42:47.505242 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:47.505224    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-bfc5w_openshift-console-operator(cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" podUID="cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b"
Jun 11 23:42:52.231045 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.231003    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:42:52.231442 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:52.231145    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:52.231442 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:52.231206    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls podName:dd833a57-64b0-4eb9-922c-a51f1bd61190 nodeName:}" failed. No retries permitted until 2026-06-11 23:43:08.231191617 +0000 UTC m=+266.856264828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-cgm6g" (UID: "dd833a57-64b0-4eb9-922c-a51f1bd61190") : secret "cluster-monitoring-operator-tls" not found
Jun 11 23:42:52.332344 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.332312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:52.332486 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.332393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:42:52.332486 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.332412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:52.332486 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:52.332444    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 11 23:42:52.332613 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:52.332518    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:43:08.332503519 +0000 UTC m=+266.957576730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : secret "router-metrics-certs-default" not found
Jun 11 23:42:52.332613 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:52.332552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle podName:1123599e-b4ef-4fa1-a1d9-0779307aa0c0 nodeName:}" failed. No retries permitted until 2026-06-11 23:43:08.332533897 +0000 UTC m=+266.957607110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle") pod "router-default-69d57fc9d6-56v69" (UID: "1123599e-b4ef-4fa1-a1d9-0779307aa0c0") : configmap references non-existent config key: service-ca.crt
Jun 11 23:42:52.334730 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.334710    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"image-registry-644fcfc5b4-wgrd5\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") " pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:52.391216 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.391197    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h6777\""
Jun 11 23:42:52.399588 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.399572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:52.521625 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:52.521557    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644fcfc5b4-wgrd5"]
Jun 11 23:42:52.525380 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:42:52.525350    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a0cef3_838f_48d4_a42a_ef106ba9dceb.slice/crio-8facbc12fbd943e28d4ba0e15295aed0eac512170255af1e00624c627e0a77e1 WatchSource:0}: Error finding container 8facbc12fbd943e28d4ba0e15295aed0eac512170255af1e00624c627e0a77e1: Status 404 returned error can't find the container with id 8facbc12fbd943e28d4ba0e15295aed0eac512170255af1e00624c627e0a77e1
Jun 11 23:42:53.524053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:53.524018    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" event={"ID":"92a0cef3-838f-48d4-a42a-ef106ba9dceb","Type":"ContainerStarted","Data":"dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2"}
Jun 11 23:42:53.524431 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:53.524068    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" event={"ID":"92a0cef3-838f-48d4-a42a-ef106ba9dceb","Type":"ContainerStarted","Data":"8facbc12fbd943e28d4ba0e15295aed0eac512170255af1e00624c627e0a77e1"}
Jun 11 23:42:53.524431 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:53.524139    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:42:53.542396 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:53.542354    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" podStartSLOduration=17.54232016 podStartE2EDuration="17.54232016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:53.540869943 +0000 UTC m=+252.165943176" watchObservedRunningTime="2026-06-11 23:42:53.54232016 +0000 UTC m=+252.167393393"
Jun 11 23:42:53.744617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:53.744589    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:42:53.744747 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:53.744690    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 11 23:42:53.744747 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:53.744733    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs podName:615ce39c-819f-46bf-9688-acb9626db9a7 nodeName:}" failed. No retries permitted until 2026-06-11 23:44:55.744721945 +0000 UTC m=+374.369795156 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs") pod "network-metrics-daemon-5sgch" (UID: "615ce39c-819f-46bf-9688-acb9626db9a7") : secret "metrics-daemon-secret" not found
Jun 11 23:42:55.559236 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:55.559196    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:55.559593 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:55.559247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:55.559593 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:55.559371    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:55.559593 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:42:55.559420    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls podName:0f5db294-aa74-4d26-8753-0c17a23aaba2 nodeName:}" failed. No retries permitted until 2026-06-11 23:43:11.559406806 +0000 UTC m=+270.184480018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djwv4" (UID: "0f5db294-aa74-4d26-8753-0c17a23aaba2") : secret "insights-runtime-extractor-tls" not found
Jun 11 23:42:55.559731 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:55.559676    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0f5db294-aa74-4d26-8753-0c17a23aaba2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:42:58.819203 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:58.819174    2575 scope.go:117] "RemoveContainer" containerID="8f255c795241625c8cf82482b5dc38a6f9e2cf05a7ddaaaaa627a14f138126df"
Jun 11 23:42:59.544184 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:59.544158    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:42:59.544363 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:59.544246    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" event={"ID":"cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b","Type":"ContainerStarted","Data":"7b93e9aec66bdf58ab3ce4e616f5f7ec925b26e0c3e170b36d5baddaf1954640"}
Jun 11 23:42:59.544550 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:59.544529    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:59.549002 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:59.548975    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w"
Jun 11 23:42:59.561262 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:42:59.561191    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-bfc5w" podStartSLOduration=20.202869515 podStartE2EDuration="23.561149384s" totalImagesPullingTime="3.358279869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:42:59.560173518 +0000 UTC m=+258.185246753" watchObservedRunningTime="2026-06-11 23:42:59.561149384 +0000 UTC m=+258.186222616"
Jun 11 23:43:03.666149 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:03.666075    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644fcfc5b4-wgrd5"]
Jun 11 23:43:08.256934 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.256893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:43:08.259242 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.259215    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dd833a57-64b0-4eb9-922c-a51f1bd61190-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-cgm6g\" (UID: \"dd833a57-64b0-4eb9-922c-a51f1bd61190\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:43:08.358124 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.358097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:08.358269 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.358159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:08.358665 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.358642    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-service-ca-bundle\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:08.360421 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.360402    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1123599e-b4ef-4fa1-a1d9-0779307aa0c0-metrics-certs\") pod \"router-default-69d57fc9d6-56v69\" (UID: \"1123599e-b4ef-4fa1-a1d9-0779307aa0c0\") " pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:08.465122 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.465095    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-phm47\""
Jun 11 23:43:08.473099 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.473083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"
Jun 11 23:43:08.586267 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.586239    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qkgxc\""
Jun 11 23:43:08.594454 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.594428    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:08.619403 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.619376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g"]
Jun 11 23:43:08.622913 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:08.622887    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd833a57_64b0_4eb9_922c_a51f1bd61190.slice/crio-56301cec5bf83d9b502ef25b223007ee4f5ed4677ddb7a75e213128fb63ebfb2 WatchSource:0}: Error finding container 56301cec5bf83d9b502ef25b223007ee4f5ed4677ddb7a75e213128fb63ebfb2: Status 404 returned error can't find the container with id 56301cec5bf83d9b502ef25b223007ee4f5ed4677ddb7a75e213128fb63ebfb2
Jun 11 23:43:08.738963 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:08.738930    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69d57fc9d6-56v69"]
Jun 11 23:43:08.741546 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:08.741522    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1123599e_b4ef_4fa1_a1d9_0779307aa0c0.slice/crio-7abe9b256f9854c2fbd32b8b4fefc0e20c1d73c141901f4286ea42ad245d23a9 WatchSource:0}: Error finding container 7abe9b256f9854c2fbd32b8b4fefc0e20c1d73c141901f4286ea42ad245d23a9: Status 404 returned error can't find the container with id 7abe9b256f9854c2fbd32b8b4fefc0e20c1d73c141901f4286ea42ad245d23a9
Jun 11 23:43:09.583021 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:09.582900    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d57fc9d6-56v69" event={"ID":"1123599e-b4ef-4fa1-a1d9-0779307aa0c0","Type":"ContainerStarted","Data":"411bc346e93f20ed8f51e108386092d158dcd030333bfb2961f76d2c63bf565e"}
Jun 11 23:43:09.583021 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:09.582965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69d57fc9d6-56v69" event={"ID":"1123599e-b4ef-4fa1-a1d9-0779307aa0c0","Type":"ContainerStarted","Data":"7abe9b256f9854c2fbd32b8b4fefc0e20c1d73c141901f4286ea42ad245d23a9"}
Jun 11 23:43:09.584117 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:09.584095    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g" event={"ID":"dd833a57-64b0-4eb9-922c-a51f1bd61190","Type":"ContainerStarted","Data":"56301cec5bf83d9b502ef25b223007ee4f5ed4677ddb7a75e213128fb63ebfb2"}
Jun 11 23:43:09.595184 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:09.595162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:09.597903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:09.597884    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:09.604272 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:09.604236    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69d57fc9d6-56v69" podStartSLOduration=33.604225046 podStartE2EDuration="33.604225046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:09.602509659 +0000 UTC m=+268.227582891" watchObservedRunningTime="2026-06-11 23:43:09.604225046 +0000 UTC m=+268.229298279"
Jun 11 23:43:10.589387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.589292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g" event={"ID":"dd833a57-64b0-4eb9-922c-a51f1bd61190","Type":"ContainerStarted","Data":"c467fe860086621f3507753a0ce92142ab35ef5f55927be25d4b5181e5658c4a"}
Jun 11 23:43:10.589716 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.589704    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:10.590772 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.590750    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69d57fc9d6-56v69"
Jun 11 23:43:10.610120 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.610073    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-cgm6g" podStartSLOduration=33.004182436 podStartE2EDuration="34.610059616s" totalImagesPullingTime="1.60587718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:10.608126489 +0000 UTC m=+269.233199722" watchObservedRunningTime="2026-06-11 23:43:10.610059616 +0000 UTC m=+269.235132849"
Jun 11 23:43:10.739465 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.739435    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"]
Jun 11 23:43:10.741489 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.741466    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:10.743990 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.743970    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 11 23:43:10.744103 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.743992    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6lqwv\""
Jun 11 23:43:10.746142 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.746121    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"]
Jun 11 23:43:10.883167 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.883102    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ac0c1e4-17fa-4108-8e78-eb6817735945-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-54lf8\" (UID: \"5ac0c1e4-17fa-4108-8e78-eb6817735945\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:10.983682 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:10.983657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ac0c1e4-17fa-4108-8e78-eb6817735945-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-54lf8\" (UID: \"5ac0c1e4-17fa-4108-8e78-eb6817735945\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:10.983787 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:43:10.983762    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jun 11 23:43:10.983828 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:43:10.983809    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac0c1e4-17fa-4108-8e78-eb6817735945-tls-certificates podName:5ac0c1e4-17fa-4108-8e78-eb6817735945 nodeName:}" failed. No retries permitted until 2026-06-11 23:43:11.483795907 +0000 UTC m=+270.108869118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5ac0c1e4-17fa-4108-8e78-eb6817735945-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-54lf8" (UID: "5ac0c1e4-17fa-4108-8e78-eb6817735945") : secret "prometheus-operator-admission-webhook-tls" not found
Jun 11 23:43:11.487244 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.487211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ac0c1e4-17fa-4108-8e78-eb6817735945-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-54lf8\" (UID: \"5ac0c1e4-17fa-4108-8e78-eb6817735945\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:11.489548 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.489528    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5ac0c1e4-17fa-4108-8e78-eb6817735945-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-54lf8\" (UID: \"5ac0c1e4-17fa-4108-8e78-eb6817735945\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:11.587813 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.587778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:43:11.589928 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.589906    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0f5db294-aa74-4d26-8753-0c17a23aaba2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djwv4\" (UID: \"0f5db294-aa74-4d26-8753-0c17a23aaba2\") " pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:43:11.599546 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.599528    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-skbjq\""
Jun 11 23:43:11.607787 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.607770    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-djwv4"
Jun 11 23:43:11.650611 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.650583    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:11.759008 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.758978    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-djwv4"]
Jun 11 23:43:11.762344 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:11.762278    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5db294_aa74_4d26_8753_0c17a23aaba2.slice/crio-c7591e83fb827bbfd13facdfb901a7677820b262f4faf70c942eea6a2a175ffc WatchSource:0}: Error finding container c7591e83fb827bbfd13facdfb901a7677820b262f4faf70c942eea6a2a175ffc: Status 404 returned error can't find the container with id c7591e83fb827bbfd13facdfb901a7677820b262f4faf70c942eea6a2a175ffc
Jun 11 23:43:11.791011 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:11.790985    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"]
Jun 11 23:43:11.794516 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:11.794494    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac0c1e4_17fa_4108_8e78_eb6817735945.slice/crio-20638ca9011d4c5c22f996475f2f5d6aecf994619ce5afbf591c820a0265ed53 WatchSource:0}: Error finding container 20638ca9011d4c5c22f996475f2f5d6aecf994619ce5afbf591c820a0265ed53: Status 404 returned error can't find the container with id 20638ca9011d4c5c22f996475f2f5d6aecf994619ce5afbf591c820a0265ed53
Jun 11 23:43:12.598350 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:12.598299    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8" event={"ID":"5ac0c1e4-17fa-4108-8e78-eb6817735945","Type":"ContainerStarted","Data":"20638ca9011d4c5c22f996475f2f5d6aecf994619ce5afbf591c820a0265ed53"}
Jun 11 23:43:12.602049 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:12.602023    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djwv4" event={"ID":"0f5db294-aa74-4d26-8753-0c17a23aaba2","Type":"ContainerStarted","Data":"c7591e83fb827bbfd13facdfb901a7677820b262f4faf70c942eea6a2a175ffc"}
Jun 11 23:43:13.606049 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:13.606017    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8" event={"ID":"5ac0c1e4-17fa-4108-8e78-eb6817735945","Type":"ContainerStarted","Data":"554baa40adb7dc22048cc377749a4e09e1f0deea43ddf40f12f7236bcc37557c"}
Jun 11 23:43:13.606507 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:13.606308    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:13.612038 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:13.612016    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8"
Jun 11 23:43:13.622875 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:13.622822    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-54lf8" podStartSLOduration=2.390116859 podStartE2EDuration="3.622810235s" totalImagesPullingTime="1.232693376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:13.62071788 +0000 UTC m=+272.245791112" watchObservedRunningTime="2026-06-11 23:43:13.622810235 +0000 UTC m=+272.247883446"
Jun 11 23:43:13.672795 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:13.672769    2575 patch_prober.go:28] interesting pod/image-registry-644fcfc5b4-wgrd5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 23:43:13.672926 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:13.672813    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 23:43:17.627238 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:17.627202    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djwv4" event={"ID":"0f5db294-aa74-4d26-8753-0c17a23aaba2","Type":"ContainerStarted","Data":"c4134dde880deb3e8612f193cf03bf136f19506853c5fca1993a9ea107978bf6"}
Jun 11 23:43:17.627650 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:17.627258    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djwv4" event={"ID":"0f5db294-aa74-4d26-8753-0c17a23aaba2","Type":"ContainerStarted","Data":"43a30017ccd5b621bec019f532444259bafa1a52bbcf4da246ec4e9d049edcdb"}
Jun 11 23:43:19.636129 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:19.636098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djwv4" event={"ID":"0f5db294-aa74-4d26-8753-0c17a23aaba2","Type":"ContainerStarted","Data":"689ce156318559eaf5247c7d8c9d022bbef353264cef0db3cd3275fd62c32672"}
Jun 11 23:43:19.656228 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:19.656182    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-djwv4" podStartSLOduration=33.815926461 podStartE2EDuration="40.656168922s" totalImagesPullingTime="6.840242461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 23:42:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:19.654096925 +0000 UTC m=+278.279170159" watchObservedRunningTime="2026-06-11 23:43:19.656168922 +0000 UTC m=+278.281242180"
Jun 11 23:43:20.139270 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.139235    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"]
Jun 11 23:43:20.141462 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.141447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.144314 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.144282    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 11 23:43:20.144314 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.144303    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 11 23:43:20.144499 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.144372    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 11 23:43:20.145534 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.145517    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rlcfm\""
Jun 11 23:43:20.155495 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.155474    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-swrp6"]
Jun 11 23:43:20.162637 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.162614    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"]
Jun 11 23:43:20.162755 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.162740    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.165611 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.165573    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 11 23:43:20.165742 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.165728    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 11 23:43:20.166094 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.166079    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-59p27\""
Jun 11 23:43:20.166346 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.166310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 11 23:43:20.166412 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.166366    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"]
Jun 11 23:43:20.168572 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.168553    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.170950 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.170933    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d6gz8\""
Jun 11 23:43:20.171140 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.171126    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 11 23:43:20.171228 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.171162    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 11 23:43:20.171342 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.171314    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 11 23:43:20.179751 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.179730    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"]
Jun 11 23:43:20.258579 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.258708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee6cff7-6575-4631-af85-7b3572534484-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.258708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-tls\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.258708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmqw\" (UniqueName: \"kubernetes.io/projected/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-kube-api-access-gkmqw\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.258708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr9qz\" (UniqueName: \"kubernetes.io/projected/0ee6cff7-6575-4631-af85-7b3572534484-kube-api-access-cr9qz\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.258708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-sys\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-root\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-metrics-client-ca\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.258966 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.259223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258969    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwbx\" (UniqueName: \"kubernetes.io/projected/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-api-access-qxwbx\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.259223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.258997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ee6cff7-6575-4631-af85-7b3572534484-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.259223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.259039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ee6cff7-6575-4631-af85-7b3572534484-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.259223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.259077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-textfile\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.259223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.259094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.259223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.259122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-wtmp\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.359750 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.359722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr9qz\" (UniqueName: \"kubernetes.io/projected/0ee6cff7-6575-4631-af85-7b3572534484-kube-api-access-cr9qz\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.359872 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.359759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.359872 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.359791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.359872 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.359817    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.359872 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.359844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-sys\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360061 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.359881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.360061 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360001    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-sys\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360061 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360006    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-root\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360061 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-root\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360258 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-metrics-client-ca\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360258 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360128    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.360258 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwbx\" (UniqueName: \"kubernetes.io/projected/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-api-access-qxwbx\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.360579 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ee6cff7-6575-4631-af85-7b3572534484-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.360676 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ee6cff7-6575-4631-af85-7b3572534484-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.360676 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360643    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.360676 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360658    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-metrics-client-ca\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-textfile\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.360853 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-wtmp\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.361005 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.361005 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee6cff7-6575-4631-af85-7b3572534484-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.361005 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360925    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-tls\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.361005 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.360952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmqw\" (UniqueName: \"kubernetes.io/projected/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-kube-api-access-gkmqw\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.361256 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.361027    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.361256 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.361174    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-wtmp\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.361492 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.361466    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-textfile\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.361566 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.361519    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.361621 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.361600    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ee6cff7-6575-4631-af85-7b3572534484-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.361983 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.361955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-accelerators-collector-config\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.362812 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.362785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.362972 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.362952    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.363118 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.363087    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.364254 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.364223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-node-exporter-tls\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.364454 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.364433    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ee6cff7-6575-4631-af85-7b3572534484-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.364505 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.364466    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee6cff7-6575-4631-af85-7b3572534484-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.369652 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.369624    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr9qz\" (UniqueName: \"kubernetes.io/projected/0ee6cff7-6575-4631-af85-7b3572534484-kube-api-access-cr9qz\") pod \"openshift-state-metrics-6b8d965dd5-zz6tw\" (UID: \"0ee6cff7-6575-4631-af85-7b3572534484\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.369652 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.369648    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwbx\" (UniqueName: \"kubernetes.io/projected/4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7-kube-api-access-qxwbx\") pod \"kube-state-metrics-678bc549d7-zp4nm\" (UID: \"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.369945 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.369931    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmqw\" (UniqueName: \"kubernetes.io/projected/c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0-kube-api-access-gkmqw\") pod \"node-exporter-swrp6\" (UID: \"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0\") " pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.450917 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.450865    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"
Jun 11 23:43:20.472290 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.472267    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-swrp6"
Jun 11 23:43:20.478732 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.478712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"
Jun 11 23:43:20.482222 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:20.482195    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d789ef_3f56_4d6a_9abf_25b8ad1e1bf0.slice/crio-1bcef91a2ce3843d589dcdbf13b1fcfad5f4b13cfe65c1c8a13a1fa7d590c7b4 WatchSource:0}: Error finding container 1bcef91a2ce3843d589dcdbf13b1fcfad5f4b13cfe65c1c8a13a1fa7d590c7b4: Status 404 returned error can't find the container with id 1bcef91a2ce3843d589dcdbf13b1fcfad5f4b13cfe65c1c8a13a1fa7d590c7b4
Jun 11 23:43:20.588518 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.588488    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw"]
Jun 11 23:43:20.591848 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:20.591823    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee6cff7_6575_4631_af85_7b3572534484.slice/crio-dbc29bb9f9cc1ef517e40b7d00d5fc58f0f178bf79bf6fb31d0cff1b97d2a223 WatchSource:0}: Error finding container dbc29bb9f9cc1ef517e40b7d00d5fc58f0f178bf79bf6fb31d0cff1b97d2a223: Status 404 returned error can't find the container with id dbc29bb9f9cc1ef517e40b7d00d5fc58f0f178bf79bf6fb31d0cff1b97d2a223
Jun 11 23:43:20.608976 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.608956    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm"]
Jun 11 23:43:20.620206 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:20.620181    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc4bac2_b8fd_48d1_8b4c_c94007a26ff7.slice/crio-1e9a052d4de67ba25c97dffa6a6926e14ac1d6142dc4b88c472ffe84a25ad39f WatchSource:0}: Error finding container 1e9a052d4de67ba25c97dffa6a6926e14ac1d6142dc4b88c472ffe84a25ad39f: Status 404 returned error can't find the container with id 1e9a052d4de67ba25c97dffa6a6926e14ac1d6142dc4b88c472ffe84a25ad39f
Jun 11 23:43:20.640582 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.640559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw" event={"ID":"0ee6cff7-6575-4631-af85-7b3572534484","Type":"ContainerStarted","Data":"dbc29bb9f9cc1ef517e40b7d00d5fc58f0f178bf79bf6fb31d0cff1b97d2a223"}
Jun 11 23:43:20.641805 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.641779    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm" event={"ID":"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7","Type":"ContainerStarted","Data":"1e9a052d4de67ba25c97dffa6a6926e14ac1d6142dc4b88c472ffe84a25ad39f"}
Jun 11 23:43:20.642996 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:20.642971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swrp6" event={"ID":"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0","Type":"ContainerStarted","Data":"1bcef91a2ce3843d589dcdbf13b1fcfad5f4b13cfe65c1c8a13a1fa7d590c7b4"}
Jun 11 23:43:21.648166 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:21.648124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw" event={"ID":"0ee6cff7-6575-4631-af85-7b3572534484","Type":"ContainerStarted","Data":"755b7c6c0aa313d0f2537495fdf554ed858cfe770ce3c860a5c020648e7f7136"}
Jun 11 23:43:21.648564 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:21.648188    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw" event={"ID":"0ee6cff7-6575-4631-af85-7b3572534484","Type":"ContainerStarted","Data":"3731fca965072fc17f338c1f24b4637470655270ea1939e0932a11da58cf19a8"}
Jun 11 23:43:22.125504 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.125469    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"]
Jun 11 23:43:22.129500 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.129476    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.132484 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132421    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 11 23:43:22.132484 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132426    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 11 23:43:22.132484 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132473    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 11 23:43:22.132684 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132487    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 11 23:43:22.132684 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132622    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6016rspbblejp\""
Jun 11 23:43:22.132684 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132681    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hssq8\""
Jun 11 23:43:22.132795 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.132705    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 11 23:43:22.139717 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.139697    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"]
Jun 11 23:43:22.259223 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:43:22.259191    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wnxwr" podUID="68c14c4c-a784-488b-a05b-f433997ff9aa"
Jun 11 23:43:22.276949 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.276921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.276971    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.277021    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277144 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.277080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lqp4\" (UniqueName: \"kubernetes.io/projected/e3a7b763-4fb8-404a-9141-00ba3f164052-kube-api-access-7lqp4\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277144 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.277131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-grpc-tls\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277220 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.277208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7b763-4fb8-404a-9141-00ba3f164052-metrics-client-ca\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277284 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.277267    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-tls\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.277351 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.277302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.378201 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.378408 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.379192 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lqp4\" (UniqueName: \"kubernetes.io/projected/e3a7b763-4fb8-404a-9141-00ba3f164052-kube-api-access-7lqp4\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.379192 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-grpc-tls\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.379192 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378781    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7b763-4fb8-404a-9141-00ba3f164052-metrics-client-ca\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.379192 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-tls\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.379192 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.379192 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.378883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.380319 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.380280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3a7b763-4fb8-404a-9141-00ba3f164052-metrics-client-ca\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.382928 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.382807    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-grpc-tls\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.382928 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.382884    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.383087 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.383052    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.383456 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.383263    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.384907 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.383700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-tls\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.384907 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.384489    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3a7b763-4fb8-404a-9141-00ba3f164052-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.391646 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.391608    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lqp4\" (UniqueName: \"kubernetes.io/projected/e3a7b763-4fb8-404a-9141-00ba3f164052-kube-api-access-7lqp4\") pod \"thanos-querier-69cfcb9b8b-c4msz\" (UID: \"e3a7b763-4fb8-404a-9141-00ba3f164052\") " pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.430507 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:43:22.430471    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d789ef_3f56_4d6a_9abf_25b8ad1e1bf0.slice/crio-09b9930862a4362bd1f89aa8c838822c5eacda4716a708fe4a0e7b5f4f4de765.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d789ef_3f56_4d6a_9abf_25b8ad1e1bf0.slice/crio-conmon-09b9930862a4362bd1f89aa8c838822c5eacda4716a708fe4a0e7b5f4f4de765.scope\": RecentStats: unable to find data in memory cache]"
Jun 11 23:43:22.441484 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.441462    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:22.581981 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.581955    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"]
Jun 11 23:43:22.583857 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:22.583832    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a7b763_4fb8_404a_9141_00ba3f164052.slice/crio-d5c2cbe215556c9ce6d3ce97f707a3ee39832ea447b53774427a7700ea672a0d WatchSource:0}: Error finding container d5c2cbe215556c9ce6d3ce97f707a3ee39832ea447b53774427a7700ea672a0d: Status 404 returned error can't find the container with id d5c2cbe215556c9ce6d3ce97f707a3ee39832ea447b53774427a7700ea672a0d
Jun 11 23:43:22.654023 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.653954    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw" event={"ID":"0ee6cff7-6575-4631-af85-7b3572534484","Type":"ContainerStarted","Data":"5e7ff2ed52542a3c2db35eb5154333ae08f6262f5204ac2bc772874c1ca9117c"}
Jun 11 23:43:22.655631 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.655608    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0" containerID="09b9930862a4362bd1f89aa8c838822c5eacda4716a708fe4a0e7b5f4f4de765" exitCode=0
Jun 11 23:43:22.655718 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.655693    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swrp6" event={"ID":"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0","Type":"ContainerDied","Data":"09b9930862a4362bd1f89aa8c838822c5eacda4716a708fe4a0e7b5f4f4de765"}
Jun 11 23:43:22.656833 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.656811    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"d5c2cbe215556c9ce6d3ce97f707a3ee39832ea447b53774427a7700ea672a0d"}
Jun 11 23:43:22.658956 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.658936    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:43:22.658956 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.658950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm" event={"ID":"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7","Type":"ContainerStarted","Data":"bba5711ffc218d639216675576b7071fc554087b61a0ba4909f193cfc2c92852"}
Jun 11 23:43:22.659095 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.658993    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm" event={"ID":"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7","Type":"ContainerStarted","Data":"c53395fe2b6d10112f0a8103bb47f3675867327da37c04c6109633ad835351a8"}
Jun 11 23:43:22.659095 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.659011    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm" event={"ID":"4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7","Type":"ContainerStarted","Data":"72e2b5db4c00ab8bbce192834edbd7735f805927143972c02f4f7c7ed39ad534"}
Jun 11 23:43:22.672881 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.672845    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-zz6tw" podStartSLOduration=1.151736062 podStartE2EDuration="2.672831045s" totalImagesPullingTime="1.521094983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:22.671492548 +0000 UTC m=+281.296565812" watchObservedRunningTime="2026-06-11 23:43:22.672831045 +0000 UTC m=+281.297904277"
Jun 11 23:43:22.707569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:22.707527    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-zp4nm" podStartSLOduration=1.113051068 podStartE2EDuration="2.70751319s" totalImagesPullingTime="1.594462122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:22.706600781 +0000 UTC m=+281.331674015" watchObservedRunningTime="2026-06-11 23:43:22.70751319 +0000 UTC m=+281.332586464"
Jun 11 23:43:23.664610 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:23.664563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swrp6" event={"ID":"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0","Type":"ContainerStarted","Data":"a3a0c97c1fcb8a2a0ecb7f921d16db9626795a140880363a3ac9a5573764dc3f"}
Jun 11 23:43:23.665043 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:23.664632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-swrp6" event={"ID":"c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0","Type":"ContainerStarted","Data":"f873c7ba2cc0f30029fabf71ba6fa9d4eacc9b960ee6c0e6b0e916fea3952747"}
Jun 11 23:43:23.671928 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:23.671901    2575 patch_prober.go:28] interesting pod/image-registry-644fcfc5b4-wgrd5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 11 23:43:23.672041 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:23.671950    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 11 23:43:23.685955 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:23.685912    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-swrp6" podStartSLOduration=1.881670942 podStartE2EDuration="3.685899945s" totalImagesPullingTime="1.730301315s" totalInitContainerRuntime="73.927688ms" isStatefulPod=true podCreationTimestamp="2026-06-11 23:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:23.685392526 +0000 UTC m=+282.310465763" watchObservedRunningTime="2026-06-11 23:43:23.685899945 +0000 UTC m=+282.310973177"
Jun 11 23:43:24.925726 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:24.925696    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"]
Jun 11 23:43:24.928528 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:24.928512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:24.931102 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:24.931078    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 11 23:43:24.931309 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:24.931296    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9mwts\""
Jun 11 23:43:24.937533 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:24.937511    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"]
Jun 11 23:43:25.102250 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.102229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csc4w\" (UniqueName: \"kubernetes.io/projected/8ecac60e-e169-4d3a-b932-e43de82cc570-kube-api-access-csc4w\") pod \"monitoring-plugin-589576dfc7-nn6nt\" (UID: \"8ecac60e-e169-4d3a-b932-e43de82cc570\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.102366 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.102299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ecac60e-e169-4d3a-b932-e43de82cc570-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-nn6nt\" (UID: \"8ecac60e-e169-4d3a-b932-e43de82cc570\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.202856 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.202792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csc4w\" (UniqueName: \"kubernetes.io/projected/8ecac60e-e169-4d3a-b932-e43de82cc570-kube-api-access-csc4w\") pod \"monitoring-plugin-589576dfc7-nn6nt\" (UID: \"8ecac60e-e169-4d3a-b932-e43de82cc570\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.202856 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.202836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ecac60e-e169-4d3a-b932-e43de82cc570-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-nn6nt\" (UID: \"8ecac60e-e169-4d3a-b932-e43de82cc570\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.205011 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.204985    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8ecac60e-e169-4d3a-b932-e43de82cc570-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-nn6nt\" (UID: \"8ecac60e-e169-4d3a-b932-e43de82cc570\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.211153 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.211126    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csc4w\" (UniqueName: \"kubernetes.io/projected/8ecac60e-e169-4d3a-b932-e43de82cc570-kube-api-access-csc4w\") pod \"monitoring-plugin-589576dfc7-nn6nt\" (UID: \"8ecac60e-e169-4d3a-b932-e43de82cc570\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.239110 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.239090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:25.360452 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.360421    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"]
Jun 11 23:43:25.674903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.674869    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"ce789693a86a191f391d221cd7efb556bc45b4b08d30170878a1f941d6e9aa5b"}
Jun 11 23:43:25.675069 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.674957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"e159bf40814890f3d8e09416aac982b63d62f2ff5fd121ec38565f86b26c6cda"}
Jun 11 23:43:25.675069 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.675001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"e371c26c3a16ec8da48847682a63c572aaceeda79737e969306d44d74e304ca1"}
Jun 11 23:43:25.676228 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.676192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt" event={"ID":"8ecac60e-e169-4d3a-b932-e43de82cc570","Type":"ContainerStarted","Data":"321607293b00a7c378144b3c750c91b63ab66ab44e890730e28dd3ac92bed74d"}
Jun 11 23:43:25.807090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.807056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:43:25.809586 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.809565    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68c14c4c-a784-488b-a05b-f433997ff9aa-metrics-tls\") pod \"dns-default-wnxwr\" (UID: \"68c14c4c-a784-488b-a05b-f433997ff9aa\") " pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:43:25.962233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.962168    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkcbb\""
Jun 11 23:43:25.970390 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:25.970360    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:43:26.226967 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.226938    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wnxwr"]
Jun 11 23:43:26.231022 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:43:26.230995    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c14c4c_a784_488b_a05b_f433997ff9aa.slice/crio-bdf34b9801804abb7537ea87bd98c59417c792f8d03da4850758b89ef9cc33ab WatchSource:0}: Error finding container bdf34b9801804abb7537ea87bd98c59417c792f8d03da4850758b89ef9cc33ab: Status 404 returned error can't find the container with id bdf34b9801804abb7537ea87bd98c59417c792f8d03da4850758b89ef9cc33ab
Jun 11 23:43:26.685429 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.685159    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"d3d1b6cc533e60232cc6ed54f212ed942e81cafef47797d50f34d4e910d3e941"}
Jun 11 23:43:26.685429 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.685247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"236f37e988f197c1bb718c034544168ab7dea821121af4b1a093336b243ea04a"}
Jun 11 23:43:26.685429 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.685293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" event={"ID":"e3a7b763-4fb8-404a-9141-00ba3f164052","Type":"ContainerStarted","Data":"b09464c960a6b016d015c0d2bbe3e277bc2bb7bb3a4af36a5b45f83b19c6ad44"}
Jun 11 23:43:26.685733 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.685703    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:26.686662 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.686634    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wnxwr" event={"ID":"68c14c4c-a784-488b-a05b-f433997ff9aa","Type":"ContainerStarted","Data":"bdf34b9801804abb7537ea87bd98c59417c792f8d03da4850758b89ef9cc33ab"}
Jun 11 23:43:26.709295 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:26.709245    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz" podStartSLOduration=1.336599708 podStartE2EDuration="4.709228118s" totalImagesPullingTime="3.37262841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:26.70811986 +0000 UTC m=+285.333193095" watchObservedRunningTime="2026-06-11 23:43:26.709228118 +0000 UTC m=+285.334301375"
Jun 11 23:43:27.692560 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:27.692525    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt" event={"ID":"8ecac60e-e169-4d3a-b932-e43de82cc570","Type":"ContainerStarted","Data":"bda7f1c6cdf9045ec0ba3e6d027b5af2b446f8723cd137806d51f54373d85e1d"}
Jun 11 23:43:27.693000 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:27.692766    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:27.697919 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:27.697891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt"
Jun 11 23:43:27.708806 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:27.708763    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-nn6nt" podStartSLOduration=2.2277809140000002 podStartE2EDuration="3.708747746s" totalImagesPullingTime="1.480966832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:27.707137845 +0000 UTC m=+286.332211079" watchObservedRunningTime="2026-06-11 23:43:27.708747746 +0000 UTC m=+286.333820979"
Jun 11 23:43:28.685161 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:28.685115    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerName="registry" containerID="cri-o://dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2" gracePeriod=30
Jun 11 23:43:28.698287 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:28.698260    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wnxwr" event={"ID":"68c14c4c-a784-488b-a05b-f433997ff9aa","Type":"ContainerStarted","Data":"3194ee4871bec6cd09a21044480a7b4e4123305c37f73372f0886e6f0b1f8d80"}
Jun 11 23:43:28.698635 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:28.698357    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wnxwr" event={"ID":"68c14c4c-a784-488b-a05b-f433997ff9aa","Type":"ContainerStarted","Data":"b9d9b2a6567501af630d8523b478b2020d96b933ecdc181b9fbb27a1826b11a8"}
Jun 11 23:43:28.714702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:28.714652    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wnxwr" podStartSLOduration=251.833562082 podStartE2EDuration="4m13.714635326s" totalImagesPullingTime="1.881073244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:43:28.713784248 +0000 UTC m=+287.338857480" watchObservedRunningTime="2026-06-11 23:43:28.714635326 +0000 UTC m=+287.339708559"
Jun 11 23:43:28.929561 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:28.929536    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:43:29.038515 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038488    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-certificates\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038659 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038526    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-bound-sa-token\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038659 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038584    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-installation-pull-secrets\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038659 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-trusted-ca\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038659 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038638    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv4kb\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-kube-api-access-vv4kb\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038856 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038664    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038856 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038700    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-image-registry-private-configuration\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.038856 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.038746    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92a0cef3-838f-48d4-a42a-ef106ba9dceb-ca-trust-extracted\") pod \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\" (UID: \"92a0cef3-838f-48d4-a42a-ef106ba9dceb\") "
Jun 11 23:43:29.039063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.039024    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 23:43:29.039254 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.039227    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 23:43:29.040812 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.040786    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:43:29.040995 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.040972    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:43:29.041207 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.041184    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:43:29.041207 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.041198    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:43:29.041288 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.041213    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-kube-api-access-vv4kb" (OuterVolumeSpecName: "kube-api-access-vv4kb") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "kube-api-access-vv4kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:43:29.046819 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.046798    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a0cef3-838f-48d4-a42a-ef106ba9dceb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "92a0cef3-838f-48d4-a42a-ef106ba9dceb" (UID: "92a0cef3-838f-48d4-a42a-ef106ba9dceb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 23:43:29.140235 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140216    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-certificates\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140238    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-bound-sa-token\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140248    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-installation-pull-secrets\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140257    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92a0cef3-838f-48d4-a42a-ef106ba9dceb-trusted-ca\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140265    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv4kb\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-kube-api-access-vv4kb\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140275    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92a0cef3-838f-48d4-a42a-ef106ba9dceb-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140284    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92a0cef3-838f-48d4-a42a-ef106ba9dceb-image-registry-private-configuration\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.140296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.140293    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92a0cef3-838f-48d4-a42a-ef106ba9dceb-ca-trust-extracted\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:43:29.703346 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.703299    2575 generic.go:356] "Generic (PLEG): container finished" podID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerID="dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2" exitCode=0
Jun 11 23:43:29.703724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.703365    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5"
Jun 11 23:43:29.703724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.703385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" event={"ID":"92a0cef3-838f-48d4-a42a-ef106ba9dceb","Type":"ContainerDied","Data":"dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2"}
Jun 11 23:43:29.703724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.703433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-644fcfc5b4-wgrd5" event={"ID":"92a0cef3-838f-48d4-a42a-ef106ba9dceb","Type":"ContainerDied","Data":"8facbc12fbd943e28d4ba0e15295aed0eac512170255af1e00624c627e0a77e1"}
Jun 11 23:43:29.703724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.703452    2575 scope.go:117] "RemoveContainer" containerID="dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2"
Jun 11 23:43:29.704105 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.704084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:43:29.711849 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.711832    2575 scope.go:117] "RemoveContainer" containerID="dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2"
Jun 11 23:43:29.712099 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:43:29.712081    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2\": container with ID starting with dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2 not found: ID does not exist" containerID="dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2"
Jun 11 23:43:29.712155 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.712108    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2"} err="failed to get container status \"dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2\": rpc error: code = NotFound desc = could not find container \"dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2\": container with ID starting with dd88052ac640d522b6a3f1284b62449102c41bbfaa5273eeabce413e074283b2 not found: ID does not exist"
Jun 11 23:43:29.724086 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.724063    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644fcfc5b4-wgrd5"]
Jun 11 23:43:29.729705 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.729685    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-644fcfc5b4-wgrd5"]
Jun 11 23:43:29.825606 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:29.825582    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" path="/var/lib/kubelet/pods/92a0cef3-838f-48d4-a42a-ef106ba9dceb/volumes"
Jun 11 23:43:32.698732 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:32.698705    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69cfcb9b8b-c4msz"
Jun 11 23:43:32.820464 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:43:32.820427    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5sgch" podUID="615ce39c-819f-46bf-9688-acb9626db9a7"
Jun 11 23:43:39.709970 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:39.709936    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wnxwr"
Jun 11 23:43:41.784381 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:41.784355    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:43:41.784969 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:41.784952    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:43:41.788571 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:41.788551    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:43:41.789221 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:41.789201    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:43:41.799993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:41.799978    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jun 11 23:43:46.818351 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:46.818304    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:43:50.784137 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:50.784054    2575 generic.go:356] "Generic (PLEG): container finished" podID="838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a" containerID="59c9c0bdc678d1b49861213a770bcf4e196093d38aecbb2de06b9f9c18495b58" exitCode=0
Jun 11 23:43:50.784137 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:50.784125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2" event={"ID":"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a","Type":"ContainerDied","Data":"59c9c0bdc678d1b49861213a770bcf4e196093d38aecbb2de06b9f9c18495b58"}
Jun 11 23:43:50.784568 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:50.784464    2575 scope.go:117] "RemoveContainer" containerID="59c9c0bdc678d1b49861213a770bcf4e196093d38aecbb2de06b9f9c18495b58"
Jun 11 23:43:51.789510 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:43:51.789477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-7wtv2" event={"ID":"838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a","Type":"ContainerStarted","Data":"a543399af80bb59fa1c3a86d81eb63bc31c07a454af3a05eef6f30a303ea980f"}
Jun 11 23:44:01.825784 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:01.825752    2575 generic.go:356] "Generic (PLEG): container finished" podID="2c006d1a-f1fb-40e5-b91a-b5aca8d0118c" containerID="713f154b6cddfae7a5cc25dae7861f3b761609cf50cf9dd1e9e554c480cb0d9d" exitCode=0
Jun 11 23:44:01.826209 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:01.825810    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll" event={"ID":"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c","Type":"ContainerDied","Data":"713f154b6cddfae7a5cc25dae7861f3b761609cf50cf9dd1e9e554c480cb0d9d"}
Jun 11 23:44:01.826209 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:01.826082    2575 scope.go:117] "RemoveContainer" containerID="713f154b6cddfae7a5cc25dae7861f3b761609cf50cf9dd1e9e554c480cb0d9d"
Jun 11 23:44:02.830753 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:02.830723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-gdlll" event={"ID":"2c006d1a-f1fb-40e5-b91a-b5aca8d0118c","Type":"ContainerStarted","Data":"d094adb4950b6ab549f18943b42f2aee562dd68ccfbc732356c16af7b33343e0"}
Jun 11 23:44:55.793561 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:55.793527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:44:55.795746 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:55.795727    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/615ce39c-819f-46bf-9688-acb9626db9a7-metrics-certs\") pod \"network-metrics-daemon-5sgch\" (UID: \"615ce39c-819f-46bf-9688-acb9626db9a7\") " pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:44:55.821416 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:55.821378    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hwkl\""
Jun 11 23:44:55.829532 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:55.829517    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5sgch"
Jun 11 23:44:55.975602 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:55.975577    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5sgch"]
Jun 11 23:44:55.977525 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:44:55.977498    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615ce39c_819f_46bf_9688_acb9626db9a7.slice/crio-87d8e49101f71f2b3206c049938324d99229917cf41378d1d951a991b7c4b91d WatchSource:0}: Error finding container 87d8e49101f71f2b3206c049938324d99229917cf41378d1d951a991b7c4b91d: Status 404 returned error can't find the container with id 87d8e49101f71f2b3206c049938324d99229917cf41378d1d951a991b7c4b91d
Jun 11 23:44:55.979752 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:55.979737    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 23:44:56.020156 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:56.020135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sgch" event={"ID":"615ce39c-819f-46bf-9688-acb9626db9a7","Type":"ContainerStarted","Data":"87d8e49101f71f2b3206c049938324d99229917cf41378d1d951a991b7c4b91d"}
Jun 11 23:44:57.027125 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:57.027098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sgch" event={"ID":"615ce39c-819f-46bf-9688-acb9626db9a7","Type":"ContainerStarted","Data":"17c86411e7de02c96c656352e386c0fbbff9ffb79e07d1982b83623f21aa2991"}
Jun 11 23:44:58.032464 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:58.032429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5sgch" event={"ID":"615ce39c-819f-46bf-9688-acb9626db9a7","Type":"ContainerStarted","Data":"f622449fdb4ab179123b6b9060c178ef10c0e42b58987d8bef1f6a40573b76d1"}
Jun 11 23:44:58.051138 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:44:58.051073    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5sgch" podStartSLOduration=376.171516976 podStartE2EDuration="6m17.051059684s" totalImagesPullingTime="879.542708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:38:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:44:58.050053113 +0000 UTC m=+376.675126365" watchObservedRunningTime="2026-06-11 23:44:58.051059684 +0000 UTC m=+376.676132916"
Jun 11 23:47:42.538480 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.538403    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"]
Jun 11 23:47:42.538908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.538701    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerName="registry"
Jun 11 23:47:42.538908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.538713    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerName="registry"
Jun 11 23:47:42.538908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.538775    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a0cef3-838f-48d4-a42a-ef106ba9dceb" containerName="registry"
Jun 11 23:47:42.541526 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.541511    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:47:42.544077 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.544053    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 11 23:47:42.544183 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.544076    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 11 23:47:42.545157 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.545136    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-k92bw\""
Jun 11 23:47:42.548996 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.548976    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"]
Jun 11 23:47:42.662498 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.662472    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brh52\" (UniqueName: \"kubernetes.io/projected/bb84980c-0b5e-4565-9311-53e0c44ade06-kube-api-access-brh52\") pod \"feast-operator-controller-manager-755dc57b5-zzhcm\" (UID: \"bb84980c-0b5e-4565-9311-53e0c44ade06\") " pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:47:42.763398 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.763369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brh52\" (UniqueName: \"kubernetes.io/projected/bb84980c-0b5e-4565-9311-53e0c44ade06-kube-api-access-brh52\") pod \"feast-operator-controller-manager-755dc57b5-zzhcm\" (UID: \"bb84980c-0b5e-4565-9311-53e0c44ade06\") " pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:47:42.771255 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.771233    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brh52\" (UniqueName: \"kubernetes.io/projected/bb84980c-0b5e-4565-9311-53e0c44ade06-kube-api-access-brh52\") pod \"feast-operator-controller-manager-755dc57b5-zzhcm\" (UID: \"bb84980c-0b5e-4565-9311-53e0c44ade06\") " pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:47:42.852362 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.852285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:47:42.976692 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:42.976668    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"]
Jun 11 23:47:42.979397 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:47:42.979370    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb84980c_0b5e_4565_9311_53e0c44ade06.slice/crio-82df2277473557ee7cc4d509d013ad841592fb7f7fbb50399f839bb4ef77c0dc WatchSource:0}: Error finding container 82df2277473557ee7cc4d509d013ad841592fb7f7fbb50399f839bb4ef77c0dc: Status 404 returned error can't find the container with id 82df2277473557ee7cc4d509d013ad841592fb7f7fbb50399f839bb4ef77c0dc
Jun 11 23:47:43.646174 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:43.646133    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm" event={"ID":"bb84980c-0b5e-4565-9311-53e0c44ade06","Type":"ContainerStarted","Data":"82df2277473557ee7cc4d509d013ad841592fb7f7fbb50399f839bb4ef77c0dc"}
Jun 11 23:47:45.655979 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:45.655939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm" event={"ID":"bb84980c-0b5e-4565-9311-53e0c44ade06","Type":"ContainerStarted","Data":"013d555e813b7c41d18b0adc51072f639188167a82fe0d66cfbb3f51c0879fa0"}
Jun 11 23:47:45.656366 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:45.656073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:47:45.672540 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:45.672491    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm" podStartSLOduration=1.821299565 podStartE2EDuration="3.672477112s" totalImagesPullingTime="1.851177547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:47:45.670910894 +0000 UTC m=+544.295984130" watchObservedRunningTime="2026-06-11 23:47:45.672477112 +0000 UTC m=+544.297550345"
Jun 11 23:47:56.662574 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:47:56.662544    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 11 23:48:24.309392 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.309359    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"]
Jun 11 23:48:24.313230 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.313212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.316014 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.315992    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 11 23:48:24.316139 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.316018    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 11 23:48:24.316139 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.316046    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-zsbdv\""
Jun 11 23:48:24.316139 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.316021    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 11 23:48:24.316139 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.315994    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 11 23:48:24.316382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.316370    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 11 23:48:24.316445 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.316387    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 11 23:48:24.316445 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.316403    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 11 23:48:24.323377 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.323357    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"]
Jun 11 23:48:24.344253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.344234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.344377 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.344271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.344562 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.344489    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.344647 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.344557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/085827db-ac9b-4145-bfb6-7234657b5789-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.344647 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.344600    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xp57\" (UniqueName: \"kubernetes.io/projected/085827db-ac9b-4145-bfb6-7234657b5789-kube-api-access-7xp57\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.344753 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.344651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445296 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445407 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445312    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445407 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445407 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445407 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/085827db-ac9b-4145-bfb6-7234657b5789-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445596 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:48:24.445426    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 11 23:48:24.445596 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xp57\" (UniqueName: \"kubernetes.io/projected/085827db-ac9b-4145-bfb6-7234657b5789-kube-api-access-7xp57\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.445596 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:48:24.445494    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls podName:085827db-ac9b-4145-bfb6-7234657b5789 nodeName:}" failed. No retries permitted until 2026-06-11 23:48:24.945473162 +0000 UTC m=+583.570546376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls") pod "feast-simple-feast-setup-6f588d8cb4-fvq8d" (UID: "085827db-ac9b-4145-bfb6-7234657b5789") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 11 23:48:24.445596 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:48:24.445506    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 11 23:48:24.445596 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:48:24.445555    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls podName:085827db-ac9b-4145-bfb6-7234657b5789 nodeName:}" failed. No retries permitted until 2026-06-11 23:48:24.945539202 +0000 UTC m=+583.570612423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls") pod "feast-simple-feast-setup-6f588d8cb4-fvq8d" (UID: "085827db-ac9b-4145-bfb6-7234657b5789") : secret "feast-simple-feast-setup-online-tls" not found
Jun 11 23:48:24.445863 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:48:24.445615    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 23:48:24.445863 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:48:24.445655    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls podName:085827db-ac9b-4145-bfb6-7234657b5789 nodeName:}" failed. No retries permitted until 2026-06-11 23:48:24.945641518 +0000 UTC m=+583.570714743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls") pod "feast-simple-feast-setup-6f588d8cb4-fvq8d" (UID: "085827db-ac9b-4145-bfb6-7234657b5789") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 23:48:24.445863 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.445852    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/085827db-ac9b-4145-bfb6-7234657b5789-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.447883 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.447864    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.455708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.455684    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xp57\" (UniqueName: \"kubernetes.io/projected/085827db-ac9b-4145-bfb6-7234657b5789-kube-api-access-7xp57\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.948550 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.948517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.948550 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.948556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.948745 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.948732    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.951109 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.951075    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.951223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.951129    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:24.951223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:24.951130    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-fvq8d\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:25.222427 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:25.222389    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:48:25.355852 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:25.355826    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"]
Jun 11 23:48:25.356815 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:48:25.356791    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod085827db_ac9b_4145_bfb6_7234657b5789.slice/crio-97cd9dc156327028be702466a5fb85cc4f5ca1cb8240f3c439a56bc3839fd964 WatchSource:0}: Error finding container 97cd9dc156327028be702466a5fb85cc4f5ca1cb8240f3c439a56bc3839fd964: Status 404 returned error can't find the container with id 97cd9dc156327028be702466a5fb85cc4f5ca1cb8240f3c439a56bc3839fd964
Jun 11 23:48:25.814819 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:25.814784    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"97cd9dc156327028be702466a5fb85cc4f5ca1cb8240f3c439a56bc3839fd964"}
Jun 11 23:48:41.816869 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:41.816838    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:48:41.822834 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:41.822808    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:48:41.826481 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:41.826457    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:48:41.828286 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:41.828267    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:48:57.952013 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:48:57.951915    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"}
Jun 11 23:49:02.973483 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:02.973450    2575 generic.go:356] "Generic (PLEG): container finished" podID="085827db-ac9b-4145-bfb6-7234657b5789" containerID="c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14" exitCode=0
Jun 11 23:49:02.973483 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:02.973489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"}
Jun 11 23:49:03.980394 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:03.980358    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"}
Jun 11 23:49:09.001170 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:09.001136    2575 generic.go:356] "Generic (PLEG): container finished" podID="085827db-ac9b-4145-bfb6-7234657b5789" containerID="8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935" exitCode=0
Jun 11 23:49:09.001538 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:09.001208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"}
Jun 11 23:49:09.006043 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:09.006027    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jun 11 23:49:10.011230 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.011169    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"}
Jun 11 23:49:10.011230 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.011233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"}
Jun 11 23:49:10.011775 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.011255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"}
Jun 11 23:49:10.011775 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.011272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerStarted","Data":"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"}
Jun 11 23:49:10.036808 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.036732    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podStartSLOduration=13.92199434 podStartE2EDuration="46.036707398s" totalImagesPullingTime="32.114713058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:49:10.033478947 +0000 UTC m=+628.658552181" watchObservedRunningTime="2026-06-11 23:49:10.036707398 +0000 UTC m=+628.661780632"
Jun 11 23:49:10.223288 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.223244    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:10.223486 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.223316    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:10.223486 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.223355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:10.223486 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.223374    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:10.225734 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.225689    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 11 23:49:10.225887 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.225734    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 11 23:49:10.225887 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.225746    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
Jun 11 23:49:10.226016 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:10.225863    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Jun 11 23:49:13.223578 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:13.223529    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 11 23:49:13.224063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:13.223529    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
Jun 11 23:49:13.224063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:13.223530    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Jun 11 23:49:13.224279 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:13.224242    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 11 23:49:15.222933 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:15.222903    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:15.223304 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:15.222949    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:15.223304 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:15.222961    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:15.223304 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:15.222972    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.224134 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.224100    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.224569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.224272    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.224569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.224444    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.224984 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.224962    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.225086 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.225032    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.225275 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.225261    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:16.228720 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:16.228702    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:49:17.051110 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:49:17.051077    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:50:19.676649 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.676611    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"]
Jun 11 23:50:19.677205 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.676889    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="registry" containerID="cri-o://9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77" gracePeriod=30
Jun 11 23:50:19.677205 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.676976    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online" containerID="cri-o://9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99" gracePeriod=30
Jun 11 23:50:19.677205 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.677029    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui" containerID="cri-o://a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9" gracePeriod=30
Jun 11 23:50:19.677205 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.676987    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="offline" containerID="cri-o://01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e" gracePeriod=30
Jun 11 23:50:19.953175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.953095    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"]
Jun 11 23:50:19.957373 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.957350    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:19.960021 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.959999    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-sdbls\""
Jun 11 23:50:19.972662 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:19.972638    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"]
Jun 11 23:50:20.045705 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.045646    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.045908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.045776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vvh9\" (UniqueName: \"kubernetes.io/projected/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-kube-api-access-4vvh9\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.045908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.045884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.045995 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.045919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.045995 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.045960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.045995 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.045991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.147275 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.147228    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.147460 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.147321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.147460 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.147384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.147460 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.147424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.147613 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.147485    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.147613 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.147540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvh9\" (UniqueName: \"kubernetes.io/projected/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-kube-api-access-4vvh9\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.148053 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:20.148031    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 23:50:20.148267 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:20.148254    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls podName:a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b nodeName:}" failed. No retries permitted until 2026-06-11 23:50:20.64822409 +0000 UTC m=+699.273297319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls") pod "feast-simple-feast-setup-6f588d8cb4-59524" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b") : secret "feast-simple-feast-setup-ui-tls" not found
Jun 11 23:50:20.154063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.150639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-offline-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.154063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.150973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-feast-data\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.154063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.151357    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-online-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.156268 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.156242    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-registry-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.158942 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.158917    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vvh9\" (UniqueName: \"kubernetes.io/projected/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-kube-api-access-4vvh9\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.301743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.301712    2575 generic.go:356] "Generic (PLEG): container finished" podID="085827db-ac9b-4145-bfb6-7234657b5789" containerID="a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9" exitCode=0
Jun 11 23:50:20.301864 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.301792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"}
Jun 11 23:50:20.652993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.652920    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.655303 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.655273    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls\") pod \"feast-simple-feast-setup-6f588d8cb4-59524\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") " pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:20.866772 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:20.866747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:21.003725 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:21.003701    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"]
Jun 11 23:50:21.005736 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:50:21.005700    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1947c22_3b9a_4f69_bfcd_eb1f9fb9ac6b.slice/crio-6336acf28079e0c747f8874cfb4df2502956b793871a05ca2bfbd7fc5d13c990 WatchSource:0}: Error finding container 6336acf28079e0c747f8874cfb4df2502956b793871a05ca2bfbd7fc5d13c990: Status 404 returned error can't find the container with id 6336acf28079e0c747f8874cfb4df2502956b793871a05ca2bfbd7fc5d13c990
Jun 11 23:50:21.312053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:21.311842    2575 generic.go:356] "Generic (PLEG): container finished" podID="085827db-ac9b-4145-bfb6-7234657b5789" containerID="9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99" exitCode=0
Jun 11 23:50:21.312053 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:21.311996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"}
Jun 11 23:50:21.313721 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:21.313695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"930d143f65d3cfe4e7ce6250436734958af23f0054b6ac526a16c75b17aecc7a"}
Jun 11 23:50:21.313956 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:21.313944    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"6336acf28079e0c747f8874cfb4df2502956b793871a05ca2bfbd7fc5d13c990"}
Jun 11 23:50:26.225238 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:26.225196    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 11 23:50:26.338067 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:26.338041    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerID="930d143f65d3cfe4e7ce6250436734958af23f0054b6ac526a16c75b17aecc7a" exitCode=0
Jun 11 23:50:26.338216 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:26.338096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"930d143f65d3cfe4e7ce6250436734958af23f0054b6ac526a16c75b17aecc7a"}
Jun 11 23:50:27.048637 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:27.048590    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 11 23:50:27.344309 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:27.344228    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"0ff9a1232c78a3ba8fd4e763d3dfb211ab8fd54e5430ba174570291235b7a0c6"}
Jun 11 23:50:32.367564 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:32.367534    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerID="0ff9a1232c78a3ba8fd4e763d3dfb211ab8fd54e5430ba174570291235b7a0c6" exitCode=0
Jun 11 23:50:32.367940 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:32.367606    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"0ff9a1232c78a3ba8fd4e763d3dfb211ab8fd54e5430ba174570291235b7a0c6"}
Jun 11 23:50:33.377985 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:33.377941    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"913ce0b5a96f92dacc060b69a99bc0adfd827b68eb37dc1a25b34d771ac8efed"}
Jun 11 23:50:33.378513 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:33.378014    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"ecf1c58fe2acaf425b8af957f3cb26b61bc9bcb48f6fbd9b4ff002928e11296b"}
Jun 11 23:50:33.378513 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:33.378039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"18df14f686d4ddd8eb465e90872e7910869565f1574339ae29cb0267a26eaa71"}
Jun 11 23:50:33.378513 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:33.378058    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerStarted","Data":"e9e3fcb725c743221b7dc87dcb38a92b852465f94ddc76f03827d9123d886d81"}
Jun 11 23:50:33.404184 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:33.404115    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podStartSLOduration=14.404093778 podStartE2EDuration="14.404093778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:50:33.401982777 +0000 UTC m=+712.027056011" watchObservedRunningTime="2026-06-11 23:50:33.404093778 +0000 UTC m=+712.029167012"
Jun 11 23:50:35.867313 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.867251    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:35.867820 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.867343    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:35.867820 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.867365    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:35.868091 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.868065    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:35.869431 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.869402    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 11 23:50:35.869431 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.869417    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused"
Jun 11 23:50:35.869609 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.869432    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jun 11 23:50:35.869609 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:35.869499    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
Jun 11 23:50:36.225360 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:36.225294    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 11 23:50:37.048656 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:37.048599    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 11 23:50:38.868127 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.868067    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.868564 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.868276    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.868672 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.868647    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.868749 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.868693    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.868749 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.868712    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.868749 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.868728    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.869158 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.869133    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.869243 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.869194    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.869243 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.869231    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:38.872708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:38.872692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:39.413088 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:39.413059    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:39.415982 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:39.415963    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:50:46.225043 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:46.224998    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jun 11 23:50:46.225525 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:46.225141    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:50:47.048502 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:47.048466    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jun 11 23:50:47.048675 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:47.048575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:50:50.322092 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.322071    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:50:50.390003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.389976    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xp57\" (UniqueName: \"kubernetes.io/projected/085827db-ac9b-4145-bfb6-7234657b5789-kube-api-access-7xp57\") pod \"085827db-ac9b-4145-bfb6-7234657b5789\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") "
Jun 11 23:50:50.390119 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.390010    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/085827db-ac9b-4145-bfb6-7234657b5789-feast-data\") pod \"085827db-ac9b-4145-bfb6-7234657b5789\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") "
Jun 11 23:50:50.390119 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.390031    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls\") pod \"085827db-ac9b-4145-bfb6-7234657b5789\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") "
Jun 11 23:50:50.390119 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.390051    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls\") pod \"085827db-ac9b-4145-bfb6-7234657b5789\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") "
Jun 11 23:50:50.390119 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.390078    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls\") pod \"085827db-ac9b-4145-bfb6-7234657b5789\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") "
Jun 11 23:50:50.390326 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.390130    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-offline-tls\") pod \"085827db-ac9b-4145-bfb6-7234657b5789\" (UID: \"085827db-ac9b-4145-bfb6-7234657b5789\") "
Jun 11 23:50:50.390600 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.390569    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085827db-ac9b-4145-bfb6-7234657b5789-feast-data" (OuterVolumeSpecName: "feast-data") pod "085827db-ac9b-4145-bfb6-7234657b5789" (UID: "085827db-ac9b-4145-bfb6-7234657b5789"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 23:50:50.392285 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.392259    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "085827db-ac9b-4145-bfb6-7234657b5789" (UID: "085827db-ac9b-4145-bfb6-7234657b5789"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:50:50.392607 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.392315    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085827db-ac9b-4145-bfb6-7234657b5789-kube-api-access-7xp57" (OuterVolumeSpecName: "kube-api-access-7xp57") pod "085827db-ac9b-4145-bfb6-7234657b5789" (UID: "085827db-ac9b-4145-bfb6-7234657b5789"). InnerVolumeSpecName "kube-api-access-7xp57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:50:50.392607 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.392380    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls" (OuterVolumeSpecName: "online-tls") pod "085827db-ac9b-4145-bfb6-7234657b5789" (UID: "085827db-ac9b-4145-bfb6-7234657b5789"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:50:50.392607 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.392585    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "085827db-ac9b-4145-bfb6-7234657b5789" (UID: "085827db-ac9b-4145-bfb6-7234657b5789"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:50:50.392724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.392594    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "085827db-ac9b-4145-bfb6-7234657b5789" (UID: "085827db-ac9b-4145-bfb6-7234657b5789"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:50:50.458150 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458091    2575 generic.go:356] "Generic (PLEG): container finished" podID="085827db-ac9b-4145-bfb6-7234657b5789" containerID="01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e" exitCode=137
Jun 11 23:50:50.458150 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458115    2575 generic.go:356] "Generic (PLEG): container finished" podID="085827db-ac9b-4145-bfb6-7234657b5789" containerID="9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77" exitCode=137
Jun 11 23:50:50.458150 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458123    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"}
Jun 11 23:50:50.458289 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458158    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"
Jun 11 23:50:50.458289 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"}
Jun 11 23:50:50.458289 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d" event={"ID":"085827db-ac9b-4145-bfb6-7234657b5789","Type":"ContainerDied","Data":"97cd9dc156327028be702466a5fb85cc4f5ca1cb8240f3c439a56bc3839fd964"}
Jun 11 23:50:50.458289 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.458199    2575 scope.go:117] "RemoveContainer" containerID="a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"
Jun 11 23:50:50.467315 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.467298    2575 scope.go:117] "RemoveContainer" containerID="01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"
Jun 11 23:50:50.474431 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.474417    2575 scope.go:117] "RemoveContainer" containerID="9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"
Jun 11 23:50:50.482132 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.482114    2575 scope.go:117] "RemoveContainer" containerID="9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"
Jun 11 23:50:50.482463 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.482446    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"]
Jun 11 23:50:50.486379 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.486360    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-fvq8d"]
Jun 11 23:50:50.489613 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.489585    2575 scope.go:117] "RemoveContainer" containerID="8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"
Jun 11 23:50:50.490671 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.490656    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xp57\" (UniqueName: \"kubernetes.io/projected/085827db-ac9b-4145-bfb6-7234657b5789-kube-api-access-7xp57\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:50:50.490727 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.490675    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/085827db-ac9b-4145-bfb6-7234657b5789-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:50:50.490727 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.490689    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:50:50.490727 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.490700    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:50:50.490727 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.490713    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:50:50.490727 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.490724    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/085827db-ac9b-4145-bfb6-7234657b5789-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:50:50.496275 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.496261    2575 scope.go:117] "RemoveContainer" containerID="c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"
Jun 11 23:50:50.502761 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.502733    2575 scope.go:117] "RemoveContainer" containerID="a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"
Jun 11 23:50:50.502978 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:50.502962    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9\": container with ID starting with a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9 not found: ID does not exist" containerID="a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"
Jun 11 23:50:50.503026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.502984    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"} err="failed to get container status \"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9\": rpc error: code = NotFound desc = could not find container \"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9\": container with ID starting with a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9 not found: ID does not exist"
Jun 11 23:50:50.503026 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.502999    2575 scope.go:117] "RemoveContainer" containerID="01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"
Jun 11 23:50:50.503205 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:50.503188    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e\": container with ID starting with 01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e not found: ID does not exist" containerID="01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"
Jun 11 23:50:50.503261 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503215    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"} err="failed to get container status \"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e\": rpc error: code = NotFound desc = could not find container \"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e\": container with ID starting with 01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e not found: ID does not exist"
Jun 11 23:50:50.503261 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503237    2575 scope.go:117] "RemoveContainer" containerID="9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"
Jun 11 23:50:50.503491 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:50.503475    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99\": container with ID starting with 9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99 not found: ID does not exist" containerID="9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"
Jun 11 23:50:50.503542 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503494    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"} err="failed to get container status \"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99\": rpc error: code = NotFound desc = could not find container \"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99\": container with ID starting with 9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99 not found: ID does not exist"
Jun 11 23:50:50.503542 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503506    2575 scope.go:117] "RemoveContainer" containerID="9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"
Jun 11 23:50:50.503679 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:50.503661    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77\": container with ID starting with 9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77 not found: ID does not exist" containerID="9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"
Jun 11 23:50:50.503722 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503684    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"} err="failed to get container status \"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77\": rpc error: code = NotFound desc = could not find container \"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77\": container with ID starting with 9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77 not found: ID does not exist"
Jun 11 23:50:50.503722 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503699    2575 scope.go:117] "RemoveContainer" containerID="8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"
Jun 11 23:50:50.503904 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:50.503890    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935\": container with ID starting with 8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935 not found: ID does not exist" containerID="8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"
Jun 11 23:50:50.503988 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503907    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"} err="failed to get container status \"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935\": rpc error: code = NotFound desc = could not find container \"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935\": container with ID starting with 8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935 not found: ID does not exist"
Jun 11 23:50:50.503988 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.503918    2575 scope.go:117] "RemoveContainer" containerID="c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"
Jun 11 23:50:50.504115 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:50:50.504101    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14\": container with ID starting with c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14 not found: ID does not exist" containerID="c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"
Jun 11 23:50:50.504155 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504118    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"} err="failed to get container status \"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14\": rpc error: code = NotFound desc = could not find container \"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14\": container with ID starting with c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14 not found: ID does not exist"
Jun 11 23:50:50.504155 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504131    2575 scope.go:117] "RemoveContainer" containerID="a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"
Jun 11 23:50:50.504305 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504291    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9"} err="failed to get container status \"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9\": rpc error: code = NotFound desc = could not find container \"a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9\": container with ID starting with a6e36b4d27b059c19661793ae1ccb3bffc12f12db03cd25692add603f00d7dd9 not found: ID does not exist"
Jun 11 23:50:50.504372 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504304    2575 scope.go:117] "RemoveContainer" containerID="01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"
Jun 11 23:50:50.504520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504500    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e"} err="failed to get container status \"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e\": rpc error: code = NotFound desc = could not find container \"01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e\": container with ID starting with 01f4c5b50a2300df7b2a2df554c6893341fbab76b1f4988ae8849505aa167b9e not found: ID does not exist"
Jun 11 23:50:50.504569 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504522    2575 scope.go:117] "RemoveContainer" containerID="9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"
Jun 11 23:50:50.504749 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504731    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99"} err="failed to get container status \"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99\": rpc error: code = NotFound desc = could not find container \"9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99\": container with ID starting with 9ad34ddac8a625891c353863ff0c1f85343a0a080e6936b109678a2441c4bf99 not found: ID does not exist"
Jun 11 23:50:50.504801 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504750    2575 scope.go:117] "RemoveContainer" containerID="9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"
Jun 11 23:50:50.504951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504936    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77"} err="failed to get container status \"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77\": rpc error: code = NotFound desc = could not find container \"9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77\": container with ID starting with 9642bf9bceb48f240ab11398a2b3ba149f526f4b1d52eafdbe0da872f4b4dc77 not found: ID does not exist"
Jun 11 23:50:50.504951 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.504950    2575 scope.go:117] "RemoveContainer" containerID="8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"
Jun 11 23:50:50.505145 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.505128    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935"} err="failed to get container status \"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935\": rpc error: code = NotFound desc = could not find container \"8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935\": container with ID starting with 8dfadeb2f9471adffea33ee22b74612ee59b9c04f3777e3208fc1e29b5f20935 not found: ID does not exist"
Jun 11 23:50:50.505187 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.505145    2575 scope.go:117] "RemoveContainer" containerID="c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"
Jun 11 23:50:50.505423 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:50.505323    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14"} err="failed to get container status \"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14\": rpc error: code = NotFound desc = could not find container \"c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14\": container with ID starting with c47f7f6396e6aeaafdad9e6da5c1f916aaa7b5c7a850cb60625903a326df2b14 not found: ID does not exist"
Jun 11 23:50:51.823897 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:50:51.823865    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085827db-ac9b-4145-bfb6-7234657b5789" path="/var/lib/kubelet/pods/085827db-ac9b-4145-bfb6-7234657b5789/volumes"
Jun 11 23:51:41.553156 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553121    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"]
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553504    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553518    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553531    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553537    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553546    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="offline"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553551    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="offline"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553563    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="feast-init"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553568    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="feast-init"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553573    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="feast-apply"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553578    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="feast-apply"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553589    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="registry"
Jun 11 23:51:41.553617 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553594    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="registry"
Jun 11 23:51:41.553978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553641    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="offline"
Jun 11 23:51:41.553978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553651    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="registry"
Jun 11 23:51:41.553978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553660    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="ui"
Jun 11 23:51:41.553978 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.553666    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="085827db-ac9b-4145-bfb6-7234657b5789" containerName="online"
Jun 11 23:51:41.557115 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.557097    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.559729 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559705    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 11 23:51:41.559729 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559719    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 11 23:51:41.559908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559789    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 11 23:51:41.559908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559845    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 11 23:51:41.559908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559864    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 11 23:51:41.559908 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559882    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jn54x\""
Jun 11 23:51:41.560107 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.559884    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 11 23:51:41.560107 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.560104    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 11 23:51:41.568133 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.568109    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"]
Jun 11 23:51:41.667629 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.667599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2f3d61da-e149-4277-9430-dd8bd602d61e-registry-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.667629 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.667632    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pq25\" (UniqueName: \"kubernetes.io/projected/2f3d61da-e149-4277-9430-dd8bd602d61e-kube-api-access-2pq25\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.667822 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.667662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.667822 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.667734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-online-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.667822 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.667768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-ui-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.667822 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.667795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3d61da-e149-4277-9430-dd8bd602d61e-feast-data\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.768711 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.768678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.768871 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.768720    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-online-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.768871 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.768750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-ui-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.768871 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.768779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3d61da-e149-4277-9430-dd8bd602d61e-feast-data\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.768871 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.768835    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2f3d61da-e149-4277-9430-dd8bd602d61e-registry-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.768871 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.768864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pq25\" (UniqueName: \"kubernetes.io/projected/2f3d61da-e149-4277-9430-dd8bd602d61e-kube-api-access-2pq25\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.769184 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.769165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3d61da-e149-4277-9430-dd8bd602d61e-feast-data\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.771269 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.771246    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 11 23:51:41.771428 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.771409    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 11 23:51:41.771534 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.771409    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 11 23:51:41.771534 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.771514    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 11 23:51:41.776653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.776634    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 11 23:51:41.779729 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:51:41.779681    2575 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 11 23:51:41.779826 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:51:41.779776    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls podName:2f3d61da-e149-4277-9430-dd8bd602d61e nodeName:}" failed. No retries permitted until 2026-06-11 23:51:42.27975548 +0000 UTC m=+780.904828705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls") pod "feast-simple-feast-remote-setup-7f67c7965c-cmx67" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 11 23:51:41.780227 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.780210    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2f3d61da-e149-4277-9430-dd8bd602d61e-registry-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.781938 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.781919    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-ui-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.782012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.781973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-online-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:41.786626 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.786611    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 11 23:51:41.796851 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:41.796831    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pq25\" (UniqueName: \"kubernetes.io/projected/2f3d61da-e149-4277-9430-dd8bd602d61e-kube-api-access-2pq25\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:42.372542 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:42.372516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:42.374824 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:42.374794    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls\") pod \"feast-simple-feast-remote-setup-7f67c7965c-cmx67\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:42.469119 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:42.469097    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jn54x\""
Jun 11 23:51:42.477314 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:42.477288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:42.607221 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:42.607196    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"]
Jun 11 23:51:42.609371 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:51:42.609343    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f3d61da_e149_4277_9430_dd8bd602d61e.slice/crio-2aaca105092a6e7e2246d2a82d7bf221e292430554a42433af6393ebd8c0ed43 WatchSource:0}: Error finding container 2aaca105092a6e7e2246d2a82d7bf221e292430554a42433af6393ebd8c0ed43: Status 404 returned error can't find the container with id 2aaca105092a6e7e2246d2a82d7bf221e292430554a42433af6393ebd8c0ed43
Jun 11 23:51:42.662885 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:42.662862    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerStarted","Data":"2aaca105092a6e7e2246d2a82d7bf221e292430554a42433af6393ebd8c0ed43"}
Jun 11 23:51:43.668812 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:43.668774    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerStarted","Data":"c7530275a39662f073dcd9e031cb690272cad1b6365fe1cada7b0e316282684e"}
Jun 11 23:51:47.687564 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:47.687533    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerID="c7530275a39662f073dcd9e031cb690272cad1b6365fe1cada7b0e316282684e" exitCode=0
Jun 11 23:51:47.687930 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:47.687602    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerDied","Data":"c7530275a39662f073dcd9e031cb690272cad1b6365fe1cada7b0e316282684e"}
Jun 11 23:51:48.700223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:48.700186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerStarted","Data":"0a3739865b250d2653bd890b911ce77b5eff1798f81e484d21a6a8abc480fbc4"}
Jun 11 23:51:53.722799 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:53.722768    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerID="0a3739865b250d2653bd890b911ce77b5eff1798f81e484d21a6a8abc480fbc4" exitCode=0
Jun 11 23:51:53.723167 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:53.722825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerDied","Data":"0a3739865b250d2653bd890b911ce77b5eff1798f81e484d21a6a8abc480fbc4"}
Jun 11 23:51:53.726175 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:53.726155    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jun 11 23:51:54.731892 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:54.731852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerStarted","Data":"175f3d82b8864a3bd35640ab3096bef4b280f61b170573cf489186016b85dca5"}
Jun 11 23:51:54.732253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:54.731919    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerStarted","Data":"39bfcb27a65bb9e4d91716895b6aae935b59bcbdc06ae41486850b1ebd5f0f7e"}
Jun 11 23:51:54.732253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:54.731938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerStarted","Data":"c5b00c6e5a31989219cf3ee2293bbe9195c63ca9891dd842547873e88f86f6ba"}
Jun 11 23:51:54.756020 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:54.755962    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podStartSLOduration=13.755943188 podStartE2EDuration="13.755943188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:51:54.753113179 +0000 UTC m=+793.378186415" watchObservedRunningTime="2026-06-11 23:51:54.755943188 +0000 UTC m=+793.381016420"
Jun 11 23:51:57.478202 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:57.478163    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:57.478672 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:57.478219    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:57.478672 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:57.478235    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:51:57.480088 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:57.480058    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 11 23:51:57.480210 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:57.480099    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Jun 11 23:51:57.480210 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:51:57.480078    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 11 23:52:00.478956 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.478926    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.479320 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.479041    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.479397 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.479374    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.479433 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.479412    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.479788 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.479764    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.479897 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.479816    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.482953 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.482937    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.761980 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.761895    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:52:00.764734 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:52:00.764712    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:53:02.929870 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:02.929814    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"]
Jun 11 23:53:02.930411 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:02.930083    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online" containerID="cri-o://c5b00c6e5a31989219cf3ee2293bbe9195c63ca9891dd842547873e88f86f6ba" gracePeriod=30
Jun 11 23:53:02.930411 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:02.930227    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui" containerID="cri-o://175f3d82b8864a3bd35640ab3096bef4b280f61b170573cf489186016b85dca5" gracePeriod=30
Jun 11 23:53:02.930411 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:02.930229    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="offline" containerID="cri-o://39bfcb27a65bb9e4d91716895b6aae935b59bcbdc06ae41486850b1ebd5f0f7e" gracePeriod=30
Jun 11 23:53:03.037865 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:03.037829    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"]
Jun 11 23:53:03.038140 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:03.038093    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="registry" containerID="cri-o://e9e3fcb725c743221b7dc87dcb38a92b852465f94ddc76f03827d9123d886d81" gracePeriod=30
Jun 11 23:53:03.038253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:03.038155    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui" containerID="cri-o://913ce0b5a96f92dacc060b69a99bc0adfd827b68eb37dc1a25b34d771ac8efed" gracePeriod=30
Jun 11 23:53:03.038253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:03.038194    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online" containerID="cri-o://18df14f686d4ddd8eb465e90872e7910869565f1574339ae29cb0267a26eaa71" gracePeriod=30
Jun 11 23:53:03.038253 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:03.038155    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="offline" containerID="cri-o://ecf1c58fe2acaf425b8af957f3cb26b61bc9bcb48f6fbd9b4ff002928e11296b" gracePeriod=30
Jun 11 23:53:04.017790 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.017760    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerID="175f3d82b8864a3bd35640ab3096bef4b280f61b170573cf489186016b85dca5" exitCode=0
Jun 11 23:53:04.017790 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.017782    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerID="c5b00c6e5a31989219cf3ee2293bbe9195c63ca9891dd842547873e88f86f6ba" exitCode=0
Jun 11 23:53:04.018242 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.017840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerDied","Data":"175f3d82b8864a3bd35640ab3096bef4b280f61b170573cf489186016b85dca5"}
Jun 11 23:53:04.018242 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.017889    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerDied","Data":"c5b00c6e5a31989219cf3ee2293bbe9195c63ca9891dd842547873e88f86f6ba"}
Jun 11 23:53:04.020807 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.020786    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerID="913ce0b5a96f92dacc060b69a99bc0adfd827b68eb37dc1a25b34d771ac8efed" exitCode=0
Jun 11 23:53:04.020807 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.020804    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerID="18df14f686d4ddd8eb465e90872e7910869565f1574339ae29cb0267a26eaa71" exitCode=0
Jun 11 23:53:04.020948 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.020839    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"913ce0b5a96f92dacc060b69a99bc0adfd827b68eb37dc1a25b34d771ac8efed"}
Jun 11 23:53:04.020948 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:04.020864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"18df14f686d4ddd8eb465e90872e7910869565f1574339ae29cb0267a26eaa71"}
Jun 11 23:53:08.869420 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:08.869370    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jun 11 23:53:09.413581 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:09.413541    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 11 23:53:10.479592 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:10.479541    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 11 23:53:10.762619 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:10.762536    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 11 23:53:18.868977 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:18.868929    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jun 11 23:53:19.413186 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:19.413147    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 11 23:53:20.480395 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:20.480352    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 11 23:53:20.763063 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:20.762970    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 11 23:53:28.869466 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:28.869423    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jun 11 23:53:28.869889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:28.869537    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:53:29.413798 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:29.413758    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jun 11 23:53:29.413983 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:29.413891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:53:30.479753 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:30.479712    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jun 11 23:53:30.480155 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:30.479844    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:53:30.762583 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:30.762502    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jun 11 23:53:30.762718 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:30.762619    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:53:33.138487 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.138462    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerID="ecf1c58fe2acaf425b8af957f3cb26b61bc9bcb48f6fbd9b4ff002928e11296b" exitCode=137
Jun 11 23:53:33.138487 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.138485    2575 generic.go:356] "Generic (PLEG): container finished" podID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerID="e9e3fcb725c743221b7dc87dcb38a92b852465f94ddc76f03827d9123d886d81" exitCode=137
Jun 11 23:53:33.138877 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.138530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"ecf1c58fe2acaf425b8af957f3cb26b61bc9bcb48f6fbd9b4ff002928e11296b"}
Jun 11 23:53:33.138877 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.138574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"e9e3fcb725c743221b7dc87dcb38a92b852465f94ddc76f03827d9123d886d81"}
Jun 11 23:53:33.141262 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.141239    2575 generic.go:356] "Generic (PLEG): container finished" podID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerID="39bfcb27a65bb9e4d91716895b6aae935b59bcbdc06ae41486850b1ebd5f0f7e" exitCode=137
Jun 11 23:53:33.141384 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.141306    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerDied","Data":"39bfcb27a65bb9e4d91716895b6aae935b59bcbdc06ae41486850b1ebd5f0f7e"}
Jun 11 23:53:33.579156 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.579133    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:53:33.585387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.584176    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2f3d61da-e149-4277-9430-dd8bd602d61e-registry-tls\") pod \"2f3d61da-e149-4277-9430-dd8bd602d61e\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") "
Jun 11 23:53:33.585387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.584227    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-ui-tls\") pod \"2f3d61da-e149-4277-9430-dd8bd602d61e\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") "
Jun 11 23:53:33.585387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.584294    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3d61da-e149-4277-9430-dd8bd602d61e-feast-data\") pod \"2f3d61da-e149-4277-9430-dd8bd602d61e\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") "
Jun 11 23:53:33.585387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.584372    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-online-tls\") pod \"2f3d61da-e149-4277-9430-dd8bd602d61e\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") "
Jun 11 23:53:33.585387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.584407    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls\") pod \"2f3d61da-e149-4277-9430-dd8bd602d61e\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") "
Jun 11 23:53:33.585387 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.584445    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pq25\" (UniqueName: \"kubernetes.io/projected/2f3d61da-e149-4277-9430-dd8bd602d61e-kube-api-access-2pq25\") pod \"2f3d61da-e149-4277-9430-dd8bd602d61e\" (UID: \"2f3d61da-e149-4277-9430-dd8bd602d61e\") "
Jun 11 23:53:33.586583 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.586553    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3d61da-e149-4277-9430-dd8bd602d61e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2f3d61da-e149-4277-9430-dd8bd602d61e" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 11 23:53:33.586936 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.586915    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f3d61da-e149-4277-9430-dd8bd602d61e-feast-data" (OuterVolumeSpecName: "feast-data") pod "2f3d61da-e149-4277-9430-dd8bd602d61e" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 23:53:33.588899 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.588831    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3d61da-e149-4277-9430-dd8bd602d61e-kube-api-access-2pq25" (OuterVolumeSpecName: "kube-api-access-2pq25") pod "2f3d61da-e149-4277-9430-dd8bd602d61e" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e"). InnerVolumeSpecName "kube-api-access-2pq25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:53:33.589734 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.589693    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2f3d61da-e149-4277-9430-dd8bd602d61e" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.589842 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.589716    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2f3d61da-e149-4277-9430-dd8bd602d61e" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.589900 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.589842    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-online-tls" (OuterVolumeSpecName: "online-tls") pod "2f3d61da-e149-4277-9430-dd8bd602d61e" (UID: "2f3d61da-e149-4277-9430-dd8bd602d61e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.685041 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.685019    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.685041 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.685042    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pq25\" (UniqueName: \"kubernetes.io/projected/2f3d61da-e149-4277-9430-dd8bd602d61e-kube-api-access-2pq25\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.685233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.685052    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2f3d61da-e149-4277-9430-dd8bd602d61e-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.685233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.685061    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.685233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.685069    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2f3d61da-e149-4277-9430-dd8bd602d61e-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.685233 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.685076    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2f3d61da-e149-4277-9430-dd8bd602d61e-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.690069 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.690050    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:53:33.785907 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.785879    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-online-tls\") pod \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") "
Jun 11 23:53:33.786012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.785916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-registry-tls\") pod \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") "
Jun 11 23:53:33.786012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.785939    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vvh9\" (UniqueName: \"kubernetes.io/projected/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-kube-api-access-4vvh9\") pod \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") "
Jun 11 23:53:33.786012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.785959    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls\") pod \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") "
Jun 11 23:53:33.786012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.785978    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-feast-data\") pod \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") "
Jun 11 23:53:33.786012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.786001    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-offline-tls\") pod \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\" (UID: \"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b\") "
Jun 11 23:53:33.786540 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.786510    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-feast-data" (OuterVolumeSpecName: "feast-data") pod "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 23:53:33.788135 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.788108    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-kube-api-access-4vvh9" (OuterVolumeSpecName: "kube-api-access-4vvh9") pod "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b"). InnerVolumeSpecName "kube-api-access-4vvh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:53:33.788220 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.788147    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-online-tls" (OuterVolumeSpecName: "online-tls") pod "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.788220 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.788161    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.788400 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.788378    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.788467 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.788401    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" (UID: "a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:53:33.886476 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.886451    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vvh9\" (UniqueName: \"kubernetes.io/projected/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-kube-api-access-4vvh9\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.886476 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.886474    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.886608 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.886488    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.886608 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.886501    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.886608 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.886512    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:33.886608 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:33.886522    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:53:34.148176 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.148104    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"
Jun 11 23:53:34.148176 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.148114    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524" event={"ID":"a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b","Type":"ContainerDied","Data":"6336acf28079e0c747f8874cfb4df2502956b793871a05ca2bfbd7fc5d13c990"}
Jun 11 23:53:34.148176 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.148172    2575 scope.go:117] "RemoveContainer" containerID="913ce0b5a96f92dacc060b69a99bc0adfd827b68eb37dc1a25b34d771ac8efed"
Jun 11 23:53:34.151096 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.151069    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67" event={"ID":"2f3d61da-e149-4277-9430-dd8bd602d61e","Type":"ContainerDied","Data":"2aaca105092a6e7e2246d2a82d7bf221e292430554a42433af6393ebd8c0ed43"}
Jun 11 23:53:34.151172 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.151099    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"
Jun 11 23:53:34.157374 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.157356    2575 scope.go:117] "RemoveContainer" containerID="ecf1c58fe2acaf425b8af957f3cb26b61bc9bcb48f6fbd9b4ff002928e11296b"
Jun 11 23:53:34.164859 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.164838    2575 scope.go:117] "RemoveContainer" containerID="18df14f686d4ddd8eb465e90872e7910869565f1574339ae29cb0267a26eaa71"
Jun 11 23:53:34.166493 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.166473    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"]
Jun 11 23:53:34.170673 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.170654    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6f588d8cb4-59524"]
Jun 11 23:53:34.173189 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.173174    2575 scope.go:117] "RemoveContainer" containerID="e9e3fcb725c743221b7dc87dcb38a92b852465f94ddc76f03827d9123d886d81"
Jun 11 23:53:34.180723 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.180702    2575 scope.go:117] "RemoveContainer" containerID="0ff9a1232c78a3ba8fd4e763d3dfb211ab8fd54e5430ba174570291235b7a0c6"
Jun 11 23:53:34.180900 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.180886    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"]
Jun 11 23:53:34.185705 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.185686    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7f67c7965c-cmx67"]
Jun 11 23:53:34.188037 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.188020    2575 scope.go:117] "RemoveContainer" containerID="930d143f65d3cfe4e7ce6250436734958af23f0054b6ac526a16c75b17aecc7a"
Jun 11 23:53:34.194531 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.194517    2575 scope.go:117] "RemoveContainer" containerID="175f3d82b8864a3bd35640ab3096bef4b280f61b170573cf489186016b85dca5"
Jun 11 23:53:34.201468 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.201452    2575 scope.go:117] "RemoveContainer" containerID="39bfcb27a65bb9e4d91716895b6aae935b59bcbdc06ae41486850b1ebd5f0f7e"
Jun 11 23:53:34.208231 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.208216    2575 scope.go:117] "RemoveContainer" containerID="c5b00c6e5a31989219cf3ee2293bbe9195c63ca9891dd842547873e88f86f6ba"
Jun 11 23:53:34.215115 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.215097    2575 scope.go:117] "RemoveContainer" containerID="0a3739865b250d2653bd890b911ce77b5eff1798f81e484d21a6a8abc480fbc4"
Jun 11 23:53:34.221624 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:34.221610    2575 scope.go:117] "RemoveContainer" containerID="c7530275a39662f073dcd9e031cb690272cad1b6365fe1cada7b0e316282684e"
Jun 11 23:53:35.823693 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:35.823663    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" path="/var/lib/kubelet/pods/2f3d61da-e149-4277-9430-dd8bd602d61e/volumes"
Jun 11 23:53:35.824183 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:35.824169    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" path="/var/lib/kubelet/pods/a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b/volumes"
Jun 11 23:53:41.848111 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:41.848083    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:53:41.852610 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:41.852592    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:53:41.852898 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:41.852882    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:53:41.856742 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:41.856719    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:53:45.817344 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817296    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-xh92h"]
Jun 11 23:53:45.817817 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817800    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="feast-init"
Jun 11 23:53:45.817873 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817820    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="feast-init"
Jun 11 23:53:45.817873 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817845    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online"
Jun 11 23:53:45.817873 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817853    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online"
Jun 11 23:53:45.817873 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817868    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="registry"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817877    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="registry"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817893    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="feast-init"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817902    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="feast-init"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817911    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="feast-apply"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817920    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="feast-apply"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817934    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="offline"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817942    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="offline"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817956    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817963    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui"
Jun 11 23:53:45.817993 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817978    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="feast-apply"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.817997    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="feast-apply"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818007    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818015    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818029    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818037    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818051    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="offline"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818058    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="offline"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818132    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="online"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818144    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="offline"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818156    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="offline"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818165    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3d61da-e149-4277-9430-dd8bd602d61e" containerName="ui"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818176    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="registry"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818184    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="online"
Jun 11 23:53:45.818265 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.818192    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1947c22-3b9a-4f69-bfcd-eb1f9fb9ac6b" containerName="ui"
Jun 11 23:53:45.823594 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.823571    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:45.825992 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.825970    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 11 23:53:45.826965 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.826875    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jun 11 23:53:45.827223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.826884    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 11 23:53:45.827223 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.826926    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-gq7hv\""
Jun 11 23:53:45.830690 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.830668    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-xh92h"]
Jun 11 23:53:45.866080 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.866055    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwvgk\" (UniqueName: \"kubernetes.io/projected/ec2aee82-4639-465a-a495-75f9eff9d62e-kube-api-access-bwvgk\") pod \"postgres-864846d4f5-xh92h\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") " pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:45.866205 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.866096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ec2aee82-4639-465a-a495-75f9eff9d62e-postgresdata\") pod \"postgres-864846d4f5-xh92h\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") " pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:45.966450 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.966415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwvgk\" (UniqueName: \"kubernetes.io/projected/ec2aee82-4639-465a-a495-75f9eff9d62e-kube-api-access-bwvgk\") pod \"postgres-864846d4f5-xh92h\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") " pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:45.966567 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.966464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ec2aee82-4639-465a-a495-75f9eff9d62e-postgresdata\") pod \"postgres-864846d4f5-xh92h\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") " pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:45.966774 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.966759    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ec2aee82-4639-465a-a495-75f9eff9d62e-postgresdata\") pod \"postgres-864846d4f5-xh92h\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") " pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:45.974261 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:45.974239    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwvgk\" (UniqueName: \"kubernetes.io/projected/ec2aee82-4639-465a-a495-75f9eff9d62e-kube-api-access-bwvgk\") pod \"postgres-864846d4f5-xh92h\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") " pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:46.134403 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:46.134327    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:53:46.255529 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:46.255498    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-xh92h"]
Jun 11 23:53:46.258380 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:53:46.258353    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec2aee82_4639_465a_a495_75f9eff9d62e.slice/crio-e9e8378dd278fdee6880a393cbcb47cf1aeb5e6b0204de2ca45e6b701debed4e WatchSource:0}: Error finding container e9e8378dd278fdee6880a393cbcb47cf1aeb5e6b0204de2ca45e6b701debed4e: Status 404 returned error can't find the container with id e9e8378dd278fdee6880a393cbcb47cf1aeb5e6b0204de2ca45e6b701debed4e
Jun 11 23:53:46.260052 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:46.260037    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 11 23:53:47.204734 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:47.204705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-xh92h" event={"ID":"ec2aee82-4639-465a-a495-75f9eff9d62e","Type":"ContainerStarted","Data":"e9e8378dd278fdee6880a393cbcb47cf1aeb5e6b0204de2ca45e6b701debed4e"}
Jun 11 23:53:52.227903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:52.227852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-xh92h" event={"ID":"ec2aee82-4639-465a-a495-75f9eff9d62e","Type":"ContainerStarted","Data":"20251a4eb9d0a83caca552d67c249a3fc6877c1599ff8947b42423728428c008"}
Jun 11 23:53:52.243413 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:52.243362    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-xh92h" podStartSLOduration=1.420459827 podStartE2EDuration="7.243321193s" totalImagesPullingTime="5.822861366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:53:52.242430775 +0000 UTC m=+910.867503999" watchObservedRunningTime="2026-06-11 23:53:52.243321193 +0000 UTC m=+910.868394426"
Jun 11 23:53:56.480463 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.480430    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"]
Jun 11 23:53:56.486462 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.486447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.489240 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.489220    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 11 23:53:56.489371 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.489356    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-kzfbw\""
Jun 11 23:53:56.490536 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.490507    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jun 11 23:53:56.490536 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.490529    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jun 11 23:53:56.490708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.490589    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jun 11 23:53:56.497887 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.497865    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"]
Jun 11 23:53:56.547269 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.547244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/05c58196-4076-456b-bc6d-bed3253b214c-feast-data\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.547395 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.547276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-registry-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.547395 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.547293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmn6h\" (UniqueName: \"kubernetes.io/projected/05c58196-4076-456b-bc6d-bed3253b214c-kube-api-access-lmn6h\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.547395 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.547372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-online-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.547558 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.547463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-offline-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.648627 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.648601    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/05c58196-4076-456b-bc6d-bed3253b214c-feast-data\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.648722 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.648639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-registry-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.648722 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.648665    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmn6h\" (UniqueName: \"kubernetes.io/projected/05c58196-4076-456b-bc6d-bed3253b214c-kube-api-access-lmn6h\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.648722 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.648718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-online-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.648881 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.648754    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-offline-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.649033 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.649011    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/05c58196-4076-456b-bc6d-bed3253b214c-feast-data\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.651074 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.651056    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-registry-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.651150 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.651129    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-offline-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.651188 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.651171    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-online-tls\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.656591 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.656573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmn6h\" (UniqueName: \"kubernetes.io/projected/05c58196-4076-456b-bc6d-bed3253b214c-kube-api-access-lmn6h\") pod \"feast-credit-scoring-6b454f755b-gg67k\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") " pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.796108 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.796056    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:53:56.932401 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:56.932377    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"]
Jun 11 23:53:56.934914 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:53:56.934877    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c58196_4076_456b_bc6d_bed3253b214c.slice/crio-24f097a66f39fb257a8919554cb1a0f52f9c6962c7b453a73eced38f159b72b8 WatchSource:0}: Error finding container 24f097a66f39fb257a8919554cb1a0f52f9c6962c7b453a73eced38f159b72b8: Status 404 returned error can't find the container with id 24f097a66f39fb257a8919554cb1a0f52f9c6962c7b453a73eced38f159b72b8
Jun 11 23:53:57.248910 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:57.248876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerStarted","Data":"2211f25599f98778e25fbe92cd46a07a2df265efdf73c95a842f2241c7143d13"}
Jun 11 23:53:57.249103 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:57.248943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerStarted","Data":"24f097a66f39fb257a8919554cb1a0f52f9c6962c7b453a73eced38f159b72b8"}
Jun 11 23:53:58.254281 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:58.254250    2575 generic.go:356] "Generic (PLEG): container finished" podID="05c58196-4076-456b-bc6d-bed3253b214c" containerID="2211f25599f98778e25fbe92cd46a07a2df265efdf73c95a842f2241c7143d13" exitCode=0
Jun 11 23:53:58.254618 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:58.254285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerDied","Data":"2211f25599f98778e25fbe92cd46a07a2df265efdf73c95a842f2241c7143d13"}
Jun 11 23:53:59.260939 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:53:59.260894    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerStarted","Data":"4333a1fa51176d55c8c9dd0e5aa1da1a5291fa48b58b9be0df6e1eb81b3a39d9"}
Jun 11 23:54:05.285217 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:05.285187    2575 generic.go:356] "Generic (PLEG): container finished" podID="05c58196-4076-456b-bc6d-bed3253b214c" containerID="4333a1fa51176d55c8c9dd0e5aa1da1a5291fa48b58b9be0df6e1eb81b3a39d9" exitCode=0
Jun 11 23:54:05.285570 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:05.285238    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerDied","Data":"4333a1fa51176d55c8c9dd0e5aa1da1a5291fa48b58b9be0df6e1eb81b3a39d9"}
Jun 11 23:54:06.294411 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.294370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerStarted","Data":"7a81d9d595056ecf83b19900f888a6fdb7eab25d8cb78f3cb4b84bf3c67c8368"}
Jun 11 23:54:06.294809 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.294449    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerStarted","Data":"19eda9897ddc8a7ca48d883b1a548813c4e82dfca9e4fbba85a3fc9abda811d5"}
Jun 11 23:54:06.294809 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.294488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerStarted","Data":"a2712480722029cd9080cdae7aa72ef4933205f1ddfc4bfbce5f902f3b32d20f"}
Jun 11 23:54:06.327310 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.327255    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podStartSLOduration=10.327239707 podStartE2EDuration="10.327239707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:54:06.326044291 +0000 UTC m=+924.951117529" watchObservedRunningTime="2026-06-11 23:54:06.327239707 +0000 UTC m=+924.952312941"
Jun 11 23:54:06.797036 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.796992    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:06.797210 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.797119    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:06.797210 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:06.797148    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:08.797349 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:08.797293    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:08.797811 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:08.797382    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:08.797811 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:08.797410    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:08.799035 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:08.799004    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 11 23:54:08.799266 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:08.799044    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Jun 11 23:54:08.799414 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:08.799051    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 11 23:54:11.797654 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:11.797299    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 11 23:54:11.798470 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:11.798447    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:11.799317 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:11.799301    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:11.804696 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:11.804677    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:12.329860 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:12.329831    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:14.797376 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:14.797322    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 11 23:54:17.797114 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:17.797084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:54:17.797776 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:54:17.797757    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:55:17.381433 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.381398    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"]
Jun 11 23:55:17.381903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.381636    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry" containerID="cri-o://a2712480722029cd9080cdae7aa72ef4933205f1ddfc4bfbce5f902f3b32d20f" gracePeriod=30
Jun 11 23:55:17.381903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.381679    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="offline" containerID="cri-o://7a81d9d595056ecf83b19900f888a6fdb7eab25d8cb78f3cb4b84bf3c67c8368" gracePeriod=30
Jun 11 23:55:17.381903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.381688    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online" containerID="cri-o://19eda9897ddc8a7ca48d883b1a548813c4e82dfca9e4fbba85a3fc9abda811d5" gracePeriod=30
Jun 11 23:55:17.393324 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.393299    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-xh92h"]
Jun 11 23:55:17.393492 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.393463    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-xh92h" podUID="ec2aee82-4639-465a-a495-75f9eff9d62e" containerName="postgres" containerID="cri-o://20251a4eb9d0a83caca552d67c249a3fc6877c1599ff8947b42423728428c008" gracePeriod=30
Jun 11 23:55:17.603228 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.603202    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec2aee82-4639-465a-a495-75f9eff9d62e" containerID="20251a4eb9d0a83caca552d67c249a3fc6877c1599ff8947b42423728428c008" exitCode=0
Jun 11 23:55:17.603378 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.603272    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-xh92h" event={"ID":"ec2aee82-4639-465a-a495-75f9eff9d62e","Type":"ContainerDied","Data":"20251a4eb9d0a83caca552d67c249a3fc6877c1599ff8947b42423728428c008"}
Jun 11 23:55:17.633616 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.633567    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:55:17.685503 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.685473    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwvgk\" (UniqueName: \"kubernetes.io/projected/ec2aee82-4639-465a-a495-75f9eff9d62e-kube-api-access-bwvgk\") pod \"ec2aee82-4639-465a-a495-75f9eff9d62e\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") "
Jun 11 23:55:17.685658 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.685531    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ec2aee82-4639-465a-a495-75f9eff9d62e-postgresdata\") pod \"ec2aee82-4639-465a-a495-75f9eff9d62e\" (UID: \"ec2aee82-4639-465a-a495-75f9eff9d62e\") "
Jun 11 23:55:17.687644 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.687609    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2aee82-4639-465a-a495-75f9eff9d62e-kube-api-access-bwvgk" (OuterVolumeSpecName: "kube-api-access-bwvgk") pod "ec2aee82-4639-465a-a495-75f9eff9d62e" (UID: "ec2aee82-4639-465a-a495-75f9eff9d62e"). InnerVolumeSpecName "kube-api-access-bwvgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:55:17.714888 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.714859    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2aee82-4639-465a-a495-75f9eff9d62e-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ec2aee82-4639-465a-a495-75f9eff9d62e" (UID: "ec2aee82-4639-465a-a495-75f9eff9d62e"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 23:55:17.786370 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.786322    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwvgk\" (UniqueName: \"kubernetes.io/projected/ec2aee82-4639-465a-a495-75f9eff9d62e-kube-api-access-bwvgk\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:17.786370 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:17.786369    2575 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ec2aee82-4639-465a-a495-75f9eff9d62e-postgresdata\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:18.608482 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.608456    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-xh92h"
Jun 11 23:55:18.608920 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.608493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-xh92h" event={"ID":"ec2aee82-4639-465a-a495-75f9eff9d62e","Type":"ContainerDied","Data":"e9e8378dd278fdee6880a393cbcb47cf1aeb5e6b0204de2ca45e6b701debed4e"}
Jun 11 23:55:18.608920 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.608545    2575 scope.go:117] "RemoveContainer" containerID="20251a4eb9d0a83caca552d67c249a3fc6877c1599ff8947b42423728428c008"
Jun 11 23:55:18.611793 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.611771    2575 generic.go:356] "Generic (PLEG): container finished" podID="05c58196-4076-456b-bc6d-bed3253b214c" containerID="19eda9897ddc8a7ca48d883b1a548813c4e82dfca9e4fbba85a3fc9abda811d5" exitCode=0
Jun 11 23:55:18.611885 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.611826    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerDied","Data":"19eda9897ddc8a7ca48d883b1a548813c4e82dfca9e4fbba85a3fc9abda811d5"}
Jun 11 23:55:18.626578 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.626555    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-xh92h"]
Jun 11 23:55:18.629706 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:18.629685    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-xh92h"]
Jun 11 23:55:19.824016 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:19.823983    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2aee82-4639-465a-a495-75f9eff9d62e" path="/var/lib/kubelet/pods/ec2aee82-4639-465a-a495-75f9eff9d62e/volumes"
Jun 11 23:55:22.326250 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:22.326209    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 11 23:55:32.326706 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:32.326664    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 11 23:55:42.326706 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:42.326670    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Jun 11 23:55:42.327084 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:42.326786    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:55:47.730704 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:47.730672    2575 generic.go:356] "Generic (PLEG): container finished" podID="05c58196-4076-456b-bc6d-bed3253b214c" containerID="7a81d9d595056ecf83b19900f888a6fdb7eab25d8cb78f3cb4b84bf3c67c8368" exitCode=137
Jun 11 23:55:47.730704 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:47.730699    2575 generic.go:356] "Generic (PLEG): container finished" podID="05c58196-4076-456b-bc6d-bed3253b214c" containerID="a2712480722029cd9080cdae7aa72ef4933205f1ddfc4bfbce5f902f3b32d20f" exitCode=137
Jun 11 23:55:47.731074 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:47.730719    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerDied","Data":"7a81d9d595056ecf83b19900f888a6fdb7eab25d8cb78f3cb4b84bf3c67c8368"}
Jun 11 23:55:47.731074 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:47.730756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerDied","Data":"a2712480722029cd9080cdae7aa72ef4933205f1ddfc4bfbce5f902f3b32d20f"}
Jun 11 23:55:47.798318 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:47.798288    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Jun 11 23:55:48.027708 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.027683    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:55:48.197356 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.197316    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-offline-tls\") pod \"05c58196-4076-456b-bc6d-bed3253b214c\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") "
Jun 11 23:55:48.197506 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.197361    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/05c58196-4076-456b-bc6d-bed3253b214c-feast-data\") pod \"05c58196-4076-456b-bc6d-bed3253b214c\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") "
Jun 11 23:55:48.197506 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.197410    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-registry-tls\") pod \"05c58196-4076-456b-bc6d-bed3253b214c\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") "
Jun 11 23:55:48.197506 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.197442    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmn6h\" (UniqueName: \"kubernetes.io/projected/05c58196-4076-456b-bc6d-bed3253b214c-kube-api-access-lmn6h\") pod \"05c58196-4076-456b-bc6d-bed3253b214c\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") "
Jun 11 23:55:48.197506 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.197495    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-online-tls\") pod \"05c58196-4076-456b-bc6d-bed3253b214c\" (UID: \"05c58196-4076-456b-bc6d-bed3253b214c\") "
Jun 11 23:55:48.199570 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.199533    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-online-tls" (OuterVolumeSpecName: "online-tls") pod "05c58196-4076-456b-bc6d-bed3253b214c" (UID: "05c58196-4076-456b-bc6d-bed3253b214c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:55:48.199680 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.199609    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c58196-4076-456b-bc6d-bed3253b214c-kube-api-access-lmn6h" (OuterVolumeSpecName: "kube-api-access-lmn6h") pod "05c58196-4076-456b-bc6d-bed3253b214c" (UID: "05c58196-4076-456b-bc6d-bed3253b214c"). InnerVolumeSpecName "kube-api-access-lmn6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 11 23:55:48.199756 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.199740    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "05c58196-4076-456b-bc6d-bed3253b214c" (UID: "05c58196-4076-456b-bc6d-bed3253b214c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:55:48.199872 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.199854    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "05c58196-4076-456b-bc6d-bed3253b214c" (UID: "05c58196-4076-456b-bc6d-bed3253b214c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 11 23:55:48.206056 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.206031    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05c58196-4076-456b-bc6d-bed3253b214c-feast-data" (OuterVolumeSpecName: "feast-data") pod "05c58196-4076-456b-bc6d-bed3253b214c" (UID: "05c58196-4076-456b-bc6d-bed3253b214c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 11 23:55:48.298520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.298472    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:48.298520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.298491    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/05c58196-4076-456b-bc6d-bed3253b214c-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:48.298520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.298500    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:48.298520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.298509    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmn6h\" (UniqueName: \"kubernetes.io/projected/05c58196-4076-456b-bc6d-bed3253b214c-kube-api-access-lmn6h\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:48.298520 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.298518    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/05c58196-4076-456b-bc6d-bed3253b214c-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 11 23:55:48.738031 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.738002    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k" event={"ID":"05c58196-4076-456b-bc6d-bed3253b214c","Type":"ContainerDied","Data":"24f097a66f39fb257a8919554cb1a0f52f9c6962c7b453a73eced38f159b72b8"}
Jun 11 23:55:48.738031 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.738020    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"
Jun 11 23:55:48.738554 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.738063    2575 scope.go:117] "RemoveContainer" containerID="7a81d9d595056ecf83b19900f888a6fdb7eab25d8cb78f3cb4b84bf3c67c8368"
Jun 11 23:55:48.747191 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.747174    2575 scope.go:117] "RemoveContainer" containerID="19eda9897ddc8a7ca48d883b1a548813c4e82dfca9e4fbba85a3fc9abda811d5"
Jun 11 23:55:48.754469 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.754455    2575 scope.go:117] "RemoveContainer" containerID="a2712480722029cd9080cdae7aa72ef4933205f1ddfc4bfbce5f902f3b32d20f"
Jun 11 23:55:48.761598 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.761571    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"]
Jun 11 23:55:48.762903 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.762873    2575 scope.go:117] "RemoveContainer" containerID="4333a1fa51176d55c8c9dd0e5aa1da1a5291fa48b58b9be0df6e1eb81b3a39d9"
Jun 11 23:55:48.764606 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.764585    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6b454f755b-gg67k"]
Jun 11 23:55:48.769989 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:48.769973    2575 scope.go:117] "RemoveContainer" containerID="2211f25599f98778e25fbe92cd46a07a2df265efdf73c95a842f2241c7143d13"
Jun 11 23:55:49.822876 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:55:49.822844    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c58196-4076-456b-bc6d-bed3253b214c" path="/var/lib/kubelet/pods/05c58196-4076-456b-bc6d-bed3253b214c/volumes"
Jun 11 23:57:46.692845 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.692814    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-9jq9s"]
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693092    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="offline"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693102    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="offline"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693115    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693121    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693135    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="feast-init"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693141    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="feast-init"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693150    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec2aee82-4639-465a-a495-75f9eff9d62e" containerName="postgres"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693155    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec2aee82-4639-465a-a495-75f9eff9d62e" containerName="postgres"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693166    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="feast-apply"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693171    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="feast-apply"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693179    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693184    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693231    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="online"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693238    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec2aee82-4639-465a-a495-75f9eff9d62e" containerName="postgres"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693246    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="offline"
Jun 11 23:57:46.693443 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.693254    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c58196-4076-456b-bc6d-bed3253b214c" containerName="registry"
Jun 11 23:57:46.696200 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.696181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 11 23:57:46.698654 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.698636    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jun 11 23:57:46.699653 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.699637    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-48kch\""
Jun 11 23:57:46.699732 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.699641    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jun 11 23:57:46.711904 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.711884    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-9jq9s"]
Jun 11 23:57:46.790004 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.789983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znf2x\" (UniqueName: \"kubernetes.io/projected/8954adc2-a49e-45bf-ac02-6edcbabe5ed5-kube-api-access-znf2x\") pod \"redis-69bbd798b6-9jq9s\" (UID: \"8954adc2-a49e-45bf-ac02-6edcbabe5ed5\") " pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 11 23:57:46.890393 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.890367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znf2x\" (UniqueName: \"kubernetes.io/projected/8954adc2-a49e-45bf-ac02-6edcbabe5ed5-kube-api-access-znf2x\") pod \"redis-69bbd798b6-9jq9s\" (UID: \"8954adc2-a49e-45bf-ac02-6edcbabe5ed5\") " pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 11 23:57:46.898496 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:46.898475    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znf2x\" (UniqueName: \"kubernetes.io/projected/8954adc2-a49e-45bf-ac02-6edcbabe5ed5-kube-api-access-znf2x\") pod \"redis-69bbd798b6-9jq9s\" (UID: \"8954adc2-a49e-45bf-ac02-6edcbabe5ed5\") " pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 11 23:57:47.005465 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:47.005442    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 11 23:57:47.134507 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:47.134476    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-9jq9s"]
Jun 11 23:57:47.137268 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:57:47.137239    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8954adc2_a49e_45bf_ac02_6edcbabe5ed5.slice/crio-d64e7427dd387c712b6fbf33d43db54f570679857b2cf609da1a409256e5a4a4 WatchSource:0}: Error finding container d64e7427dd387c712b6fbf33d43db54f570679857b2cf609da1a409256e5a4a4: Status 404 returned error can't find the container with id d64e7427dd387c712b6fbf33d43db54f570679857b2cf609da1a409256e5a4a4
Jun 11 23:57:47.182195 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:47.182166    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s" event={"ID":"8954adc2-a49e-45bf-ac02-6edcbabe5ed5","Type":"ContainerStarted","Data":"d64e7427dd387c712b6fbf33d43db54f570679857b2cf609da1a409256e5a4a4"}
Jun 11 23:57:49.192391 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:49.192361    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s" event={"ID":"8954adc2-a49e-45bf-ac02-6edcbabe5ed5","Type":"ContainerStarted","Data":"04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d"}
Jun 11 23:57:49.208695 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:49.208648    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s" podStartSLOduration=1.807736147 podStartE2EDuration="3.208632178s" totalImagesPullingTime="1.400896031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:57:49.207107929 +0000 UTC m=+1147.832181175" watchObservedRunningTime="2026-06-11 23:57:49.208632178 +0000 UTC m=+1147.833705410"
Jun 11 23:57:52.114716 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.114684    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-8c8bk"]
Jun 11 23:57:52.118473 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.118451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.120952 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.120928    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jun 11 23:57:52.123964 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.123943    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-8c8bk"]
Jun 11 23:57:52.232658 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.232635    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-postgresdata\") pod \"postgres-864846d4f5-8c8bk\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") " pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.232770 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.232667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqj5d\" (UniqueName: \"kubernetes.io/projected/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-kube-api-access-wqj5d\") pod \"postgres-864846d4f5-8c8bk\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") " pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.333889 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.333861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-postgresdata\") pod \"postgres-864846d4f5-8c8bk\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") " pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.333983 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.333900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqj5d\" (UniqueName: \"kubernetes.io/projected/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-kube-api-access-wqj5d\") pod \"postgres-864846d4f5-8c8bk\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") " pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.334240 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.334223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-postgresdata\") pod \"postgres-864846d4f5-8c8bk\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") " pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.341782 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.341763    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqj5d\" (UniqueName: \"kubernetes.io/projected/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-kube-api-access-wqj5d\") pod \"postgres-864846d4f5-8c8bk\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") " pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.428799 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.428746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 11 23:57:52.553364 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:52.553308    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-8c8bk"]
Jun 11 23:57:52.555877 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:57:52.555833    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0c10074_ccf7_4a89_8e65_a97a423a0b5a.slice/crio-f1e7ffaf2929645f6d214efe88658a0e0eabadfa4fa8c147a77c13263cd3999b WatchSource:0}: Error finding container f1e7ffaf2929645f6d214efe88658a0e0eabadfa4fa8c147a77c13263cd3999b: Status 404 returned error can't find the container with id f1e7ffaf2929645f6d214efe88658a0e0eabadfa4fa8c147a77c13263cd3999b
Jun 11 23:57:53.209882 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:53.209834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk" event={"ID":"b0c10074-ccf7-4a89-8e65-a97a423a0b5a","Type":"ContainerStarted","Data":"7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f"}
Jun 11 23:57:53.210247 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:53.209893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk" event={"ID":"b0c10074-ccf7-4a89-8e65-a97a423a0b5a","Type":"ContainerStarted","Data":"f1e7ffaf2929645f6d214efe88658a0e0eabadfa4fa8c147a77c13263cd3999b"}
Jun 11 23:57:53.224086 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:53.224026    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk" podStartSLOduration=1.224008837 podStartE2EDuration="1.224008837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:57:53.223258614 +0000 UTC m=+1151.848331861" watchObservedRunningTime="2026-06-11 23:57:53.224008837 +0000 UTC m=+1151.849082072"
Jun 11 23:57:57.634095 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.634063    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"]
Jun 11 23:57:57.640165 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.640145    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.642854 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.642832    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jun 11 23:57:57.642949 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.642851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jun 11 23:57:57.642949 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.642851    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-65n9q\""
Jun 11 23:57:57.642949 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.642838    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jun 11 23:57:57.649187 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.649169    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"]
Jun 11 23:57:57.771917 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.771891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0df8f609-5c68-414c-88a1-4201a6748259-feast-data\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.772015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.771921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbbdk\" (UniqueName: \"kubernetes.io/projected/0df8f609-5c68-414c-88a1-4201a6748259-kube-api-access-sbbdk\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.772015 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.771950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-registry-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.772102 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.772025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.872925 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.872898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.873024 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.872937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0df8f609-5c68-414c-88a1-4201a6748259-feast-data\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.873024 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.872955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbbdk\" (UniqueName: \"kubernetes.io/projected/0df8f609-5c68-414c-88a1-4201a6748259-kube-api-access-sbbdk\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.873024 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.872983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-registry-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.873122 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:57:57.873050    2575 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jun 11 23:57:57.873122 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:57:57.873117    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls podName:0df8f609-5c68-414c-88a1-4201a6748259 nodeName:}" failed. No retries permitted until 2026-06-11 23:57:58.373095952 +0000 UTC m=+1156.998169166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls") pod "feast-credit-scoring-9b5b4d5c-9qp6b" (UID: "0df8f609-5c68-414c-88a1-4201a6748259") : secret "feast-credit-scoring-online-tls" not found
Jun 11 23:57:57.873379 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.873361    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0df8f609-5c68-414c-88a1-4201a6748259-feast-data\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.875526 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.875506    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-registry-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:57.889553 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:57.889503    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbbdk\" (UniqueName: \"kubernetes.io/projected/0df8f609-5c68-414c-88a1-4201a6748259-kube-api-access-sbbdk\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:58.376977 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:58.376947    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:58.379220 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:58.379192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls\") pod \"feast-credit-scoring-9b5b4d5c-9qp6b\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") " pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:58.550119 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:58.550085    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:57:58.683948 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:58.683921    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"]
Jun 11 23:57:58.686034 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:57:58.686007    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df8f609_5c68_414c_88a1_4201a6748259.slice/crio-8f922ea703ac0411a825bb9bcf20990701fcf0dfa3ce06d9f3444e069ff9ad26 WatchSource:0}: Error finding container 8f922ea703ac0411a825bb9bcf20990701fcf0dfa3ce06d9f3444e069ff9ad26: Status 404 returned error can't find the container with id 8f922ea703ac0411a825bb9bcf20990701fcf0dfa3ce06d9f3444e069ff9ad26
Jun 11 23:57:59.236373 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:59.236327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerStarted","Data":"db78375fe00322c3b1f1e20c713bf204bb64ebc2fcb714073c3d2ab8652d6c78"}
Jun 11 23:57:59.236564 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:57:59.236390    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerStarted","Data":"8f922ea703ac0411a825bb9bcf20990701fcf0dfa3ce06d9f3444e069ff9ad26"}
Jun 11 23:58:00.241417 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:00.241388    2575 generic.go:356] "Generic (PLEG): container finished" podID="0df8f609-5c68-414c-88a1-4201a6748259" containerID="db78375fe00322c3b1f1e20c713bf204bb64ebc2fcb714073c3d2ab8652d6c78" exitCode=0
Jun 11 23:58:00.241776 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:00.241441    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerDied","Data":"db78375fe00322c3b1f1e20c713bf204bb64ebc2fcb714073c3d2ab8652d6c78"}
Jun 11 23:58:01.248073 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:01.248042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerStarted","Data":"c4cccd24ab26e05480fc643dd85fc6f6369d2b346fa7b472f956ffedd107e5cf"}
Jun 11 23:58:07.277923 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:07.277895    2575 generic.go:356] "Generic (PLEG): container finished" podID="0df8f609-5c68-414c-88a1-4201a6748259" containerID="c4cccd24ab26e05480fc643dd85fc6f6369d2b346fa7b472f956ffedd107e5cf" exitCode=0
Jun 11 23:58:07.278278 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:07.277971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerDied","Data":"c4cccd24ab26e05480fc643dd85fc6f6369d2b346fa7b472f956ffedd107e5cf"}
Jun 11 23:58:08.284524 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:08.284493    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerStarted","Data":"fb6d1e735979f8c52ee0a091dcd5b33d94a5edf66ba883c815375a1549302ac9"}
Jun 11 23:58:08.285003 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:08.284544    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerStarted","Data":"517c2911109b9d262039c6555e8fc6869a3f52aaa269959dc499605b1a46a73a"}
Jun 11 23:58:08.307372 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:08.307310    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podStartSLOduration=11.307293942 podStartE2EDuration="11.307293942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:58:08.305195502 +0000 UTC m=+1166.930268740" watchObservedRunningTime="2026-06-11 23:58:08.307293942 +0000 UTC m=+1166.932367182"
Jun 11 23:58:08.550965 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:08.550878    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:08.550965 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:08.550959    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:10.551090 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:10.551054    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:10.551530 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:10.551122    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:10.552252 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:10.552216    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Jun 11 23:58:10.552377 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:10.552259    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 11 23:58:13.550660 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:13.550619    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Jun 11 23:58:13.557661 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:13.557638    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:13.561255 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:13.561231    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:16.550770 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:16.550726    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Jun 11 23:58:19.551023 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:19.550996    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:19.551702 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:19.551683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 11 23:58:23.479098 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.479066    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"]
Jun 11 23:58:23.483879 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.483859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.486524 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.486501    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-4vzp4\""
Jun 11 23:58:23.486631 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.486546    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jun 11 23:58:23.486631 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.486594    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jun 11 23:58:23.486631 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.486546    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jun 11 23:58:23.494364 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.494325    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"]
Jun 11 23:58:23.575576 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.575554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9261019-dc86-456f-a160-a40471808b87-feast-data\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.575681 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.575598    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf9dm\" (UniqueName: \"kubernetes.io/projected/c9261019-dc86-456f-a160-a40471808b87-kube-api-access-bf9dm\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.575681 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.575621    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.575681 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.575639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.676578 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.676556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9261019-dc86-456f-a160-a40471808b87-feast-data\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.676661 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.676593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf9dm\" (UniqueName: \"kubernetes.io/projected/c9261019-dc86-456f-a160-a40471808b87-kube-api-access-bf9dm\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.676661 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.676614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.676661 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.676635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.676760 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:58:23.676714    2575 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
Jun 11 23:58:23.676804 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:58:23.676791    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls podName:c9261019-dc86-456f-a160-a40471808b87 nodeName:}" failed. No retries permitted until 2026-06-11 23:58:24.176770437 +0000 UTC m=+1182.801843648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls") pod "feast-driver-ranking-647c4f9bb-zkslr" (UID: "c9261019-dc86-456f-a160-a40471808b87") : secret "feast-driver-ranking-registry-tls" not found
Jun 11 23:58:23.676849 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:58:23.676721    2575 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
Jun 11 23:58:23.676849 ip-10-0-134-3 kubenswrapper[2575]: E0611 23:58:23.676838    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls podName:c9261019-dc86-456f-a160-a40471808b87 nodeName:}" failed. No retries permitted until 2026-06-11 23:58:24.176827288 +0000 UTC m=+1182.801900499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls") pod "feast-driver-ranking-647c4f9bb-zkslr" (UID: "c9261019-dc86-456f-a160-a40471808b87") : secret "feast-driver-ranking-online-tls" not found
Jun 11 23:58:23.676939 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.676925    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9261019-dc86-456f-a160-a40471808b87-feast-data\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:23.685247 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:23.685223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf9dm\" (UniqueName: \"kubernetes.io/projected/c9261019-dc86-456f-a160-a40471808b87-kube-api-access-bf9dm\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:24.180382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:24.180356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:24.180382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:24.180387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:24.182794 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:24.182766    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:24.182945 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:24.182861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls\") pod \"feast-driver-ranking-647c4f9bb-zkslr\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") " pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:24.393818 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:24.393789    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:24.524743 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:24.524718    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"]
Jun 11 23:58:24.525888 ip-10-0-134-3 kubenswrapper[2575]: W0611 23:58:24.525849    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9261019_dc86_456f_a160_a40471808b87.slice/crio-14ccb6365d46edf41cc2d26c2a851f9cde7c0d4f07cdf5af7bd413666b59ea87 WatchSource:0}: Error finding container 14ccb6365d46edf41cc2d26c2a851f9cde7c0d4f07cdf5af7bd413666b59ea87: Status 404 returned error can't find the container with id 14ccb6365d46edf41cc2d26c2a851f9cde7c0d4f07cdf5af7bd413666b59ea87
Jun 11 23:58:25.362905 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:25.362872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerStarted","Data":"08f65eb119029b8b8f28539a5f5a6045e3797f7c231602a77f5e784a9a099e4f"}
Jun 11 23:58:25.363071 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:25.362922    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerStarted","Data":"14ccb6365d46edf41cc2d26c2a851f9cde7c0d4f07cdf5af7bd413666b59ea87"}
Jun 11 23:58:29.381213 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:29.381185    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9261019-dc86-456f-a160-a40471808b87" containerID="08f65eb119029b8b8f28539a5f5a6045e3797f7c231602a77f5e784a9a099e4f" exitCode=0
Jun 11 23:58:29.381579 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:29.381255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerDied","Data":"08f65eb119029b8b8f28539a5f5a6045e3797f7c231602a77f5e784a9a099e4f"}
Jun 11 23:58:30.387724 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:30.387695    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerStarted","Data":"8c15239d7760b7e703cfde3d5824c79d0aac019f7aae0989ec45864f065282dc"}
Jun 11 23:58:36.414190 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:36.414119    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9261019-dc86-456f-a160-a40471808b87" containerID="8c15239d7760b7e703cfde3d5824c79d0aac019f7aae0989ec45864f065282dc" exitCode=0
Jun 11 23:58:36.414190 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:36.414161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerDied","Data":"8c15239d7760b7e703cfde3d5824c79d0aac019f7aae0989ec45864f065282dc"}
Jun 11 23:58:37.422600 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:37.422566    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerStarted","Data":"9a7b9a187def23e4b099a847c815f8fea394dec089a49407625c94adef8dd71b"}
Jun 11 23:58:37.422997 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:37.422617    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerStarted","Data":"6bd97cdf6031591513a32a90d1466974d41f6f400ecfbdda2bf4fefcc527a772"}
Jun 11 23:58:37.446264 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:37.446216    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podStartSLOduration=14.446200563 podStartE2EDuration="14.446200563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 23:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 23:58:37.445085194 +0000 UTC m=+1196.070158431" watchObservedRunningTime="2026-06-11 23:58:37.446200563 +0000 UTC m=+1196.071273795"
Jun 11 23:58:39.394279 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:39.394240    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:39.394753 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:39.394311    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:39.395967 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:39.395937    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jun 11 23:58:39.395967 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:39.395949    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 11 23:58:41.920629 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:41.920599    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:58:41.921382 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:41.921359    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 11 23:58:41.925800 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:41.925783    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:58:41.926534 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:41.926515    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 11 23:58:42.394266 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:42.394209    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jun 11 23:58:42.520848 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:42.520801    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:42.521290 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:42.521264    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:42.524184 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:42.524161    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:44.394682 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:44.394641    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:45.394553 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:45.394506    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jun 11 23:58:48.395391 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:48.395364    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 11 23:58:48.396012 ip-10-0-134-3 kubenswrapper[2575]: I0611 23:58:48.395993    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 12 00:00:01.592256 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.592224    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"]
Jun 12 00:00:01.592676 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.592466    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm" podUID="bb84980c-0b5e-4565-9311-53e0c44ade06" containerName="manager" containerID="cri-o://013d555e813b7c41d18b0adc51072f639188167a82fe0d66cfbb3f51c0879fa0" gracePeriod=10
Jun 12 00:00:01.785987 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.785877    2575 generic.go:356] "Generic (PLEG): container finished" podID="bb84980c-0b5e-4565-9311-53e0c44ade06" containerID="013d555e813b7c41d18b0adc51072f639188167a82fe0d66cfbb3f51c0879fa0" exitCode=0
Jun 12 00:00:01.785987 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.785948    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm" event={"ID":"bb84980c-0b5e-4565-9311-53e0c44ade06","Type":"ContainerDied","Data":"013d555e813b7c41d18b0adc51072f639188167a82fe0d66cfbb3f51c0879fa0"}
Jun 12 00:00:01.826428 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.826401    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"]
Jun 12 00:00:01.826882 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.826853    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry" containerID="cri-o://517c2911109b9d262039c6555e8fc6869a3f52aaa269959dc499605b1a46a73a" gracePeriod=30
Jun 12 00:00:01.827149 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.827087    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online" containerID="cri-o://fb6d1e735979f8c52ee0a091dcd5b33d94a5edf66ba883c815375a1549302ac9" gracePeriod=30
Jun 12 00:00:01.850970 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.850680    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"]
Jun 12 00:00:01.850970 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.850886    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry" containerID="cri-o://6bd97cdf6031591513a32a90d1466974d41f6f400ecfbdda2bf4fefcc527a772" gracePeriod=30
Jun 12 00:00:01.850970 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.850922    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online" containerID="cri-o://9a7b9a187def23e4b099a847c815f8fea394dec089a49407625c94adef8dd71b" gracePeriod=30
Jun 12 00:00:01.887940 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.887915    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 12 00:00:01.918162 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.918134    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brh52\" (UniqueName: \"kubernetes.io/projected/bb84980c-0b5e-4565-9311-53e0c44ade06-kube-api-access-brh52\") pod \"bb84980c-0b5e-4565-9311-53e0c44ade06\" (UID: \"bb84980c-0b5e-4565-9311-53e0c44ade06\") "
Jun 12 00:00:01.920347 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:01.920306    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb84980c-0b5e-4565-9311-53e0c44ade06-kube-api-access-brh52" (OuterVolumeSpecName: "kube-api-access-brh52") pod "bb84980c-0b5e-4565-9311-53e0c44ade06" (UID: "bb84980c-0b5e-4565-9311-53e0c44ade06"). InnerVolumeSpecName "kube-api-access-brh52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:00:02.019524 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.019493    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brh52\" (UniqueName: \"kubernetes.io/projected/bb84980c-0b5e-4565-9311-53e0c44ade06-kube-api-access-brh52\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:02.521456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.521405    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 12 00:00:02.792944 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.792889    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9261019-dc86-456f-a160-a40471808b87" containerID="9a7b9a187def23e4b099a847c815f8fea394dec089a49407625c94adef8dd71b" exitCode=0
Jun 12 00:00:02.793253 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.792965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerDied","Data":"9a7b9a187def23e4b099a847c815f8fea394dec089a49407625c94adef8dd71b"}
Jun 12 00:00:02.795291 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.795270    2575 generic.go:356] "Generic (PLEG): container finished" podID="0df8f609-5c68-414c-88a1-4201a6748259" containerID="fb6d1e735979f8c52ee0a091dcd5b33d94a5edf66ba883c815375a1549302ac9" exitCode=0
Jun 12 00:00:02.795401 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.795353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerDied","Data":"fb6d1e735979f8c52ee0a091dcd5b33d94a5edf66ba883c815375a1549302ac9"}
Jun 12 00:00:02.796367 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.796350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm" event={"ID":"bb84980c-0b5e-4565-9311-53e0c44ade06","Type":"ContainerDied","Data":"82df2277473557ee7cc4d509d013ad841592fb7f7fbb50399f839bb4ef77c0dc"}
Jun 12 00:00:02.796439 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.796392    2575 scope.go:117] "RemoveContainer" containerID="013d555e813b7c41d18b0adc51072f639188167a82fe0d66cfbb3f51c0879fa0"
Jun 12 00:00:02.796439 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.796395    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"
Jun 12 00:00:02.817995 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.817973    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"]
Jun 12 00:00:02.819456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:02.819435    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-755dc57b5-zzhcm"]
Jun 12 00:00:03.558492 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:03.558456    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 12 00:00:03.823893 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:03.823815    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb84980c-0b5e-4565-9311-53e0c44ade06" path="/var/lib/kubelet/pods/bb84980c-0b5e-4565-9311-53e0c44ade06/volumes"
Jun 12 00:00:03.962616 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:03.962586    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-8c8bk"]
Jun 12 00:00:03.962796 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:03.962772    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk" podUID="b0c10074-ccf7-4a89-8e65-a97a423a0b5a" containerName="postgres" containerID="cri-o://7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f" gracePeriod=30
Jun 12 00:00:03.967849 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:03.967827    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-9jq9s"]
Jun 12 00:00:03.967977 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:03.967960    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s" podUID="8954adc2-a49e-45bf-ac02-6edcbabe5ed5" containerName="redis" containerID="cri-o://04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d" gracePeriod=30
Jun 12 00:00:04.234806 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.234784    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 12 00:00:04.237435 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.237387    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 12 00:00:04.337178 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.337115    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-postgresdata\") pod \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") "
Jun 12 00:00:04.337178 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.337171    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqj5d\" (UniqueName: \"kubernetes.io/projected/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-kube-api-access-wqj5d\") pod \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\" (UID: \"b0c10074-ccf7-4a89-8e65-a97a423a0b5a\") "
Jun 12 00:00:04.337361 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.337211    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znf2x\" (UniqueName: \"kubernetes.io/projected/8954adc2-a49e-45bf-ac02-6edcbabe5ed5-kube-api-access-znf2x\") pod \"8954adc2-a49e-45bf-ac02-6edcbabe5ed5\" (UID: \"8954adc2-a49e-45bf-ac02-6edcbabe5ed5\") "
Jun 12 00:00:04.339315 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.339281    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-kube-api-access-wqj5d" (OuterVolumeSpecName: "kube-api-access-wqj5d") pod "b0c10074-ccf7-4a89-8e65-a97a423a0b5a" (UID: "b0c10074-ccf7-4a89-8e65-a97a423a0b5a"). InnerVolumeSpecName "kube-api-access-wqj5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:00:04.339315 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.339293    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8954adc2-a49e-45bf-ac02-6edcbabe5ed5-kube-api-access-znf2x" (OuterVolumeSpecName: "kube-api-access-znf2x") pod "8954adc2-a49e-45bf-ac02-6edcbabe5ed5" (UID: "8954adc2-a49e-45bf-ac02-6edcbabe5ed5"). InnerVolumeSpecName "kube-api-access-znf2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:00:04.369650 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.369621    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "b0c10074-ccf7-4a89-8e65-a97a423a0b5a" (UID: "b0c10074-ccf7-4a89-8e65-a97a423a0b5a"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:00:04.438224 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.438199    2575 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-postgresdata\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:04.438224 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.438224    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqj5d\" (UniqueName: \"kubernetes.io/projected/b0c10074-ccf7-4a89-8e65-a97a423a0b5a-kube-api-access-wqj5d\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:04.438418 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.438234    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znf2x\" (UniqueName: \"kubernetes.io/projected/8954adc2-a49e-45bf-ac02-6edcbabe5ed5-kube-api-access-znf2x\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:04.806795 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.806762    2575 generic.go:356] "Generic (PLEG): container finished" podID="8954adc2-a49e-45bf-ac02-6edcbabe5ed5" containerID="04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d" exitCode=0
Jun 12 00:00:04.806958 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.806806    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s"
Jun 12 00:00:04.806958 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.806847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s" event={"ID":"8954adc2-a49e-45bf-ac02-6edcbabe5ed5","Type":"ContainerDied","Data":"04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d"}
Jun 12 00:00:04.806958 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.806892    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-9jq9s" event={"ID":"8954adc2-a49e-45bf-ac02-6edcbabe5ed5","Type":"ContainerDied","Data":"d64e7427dd387c712b6fbf33d43db54f570679857b2cf609da1a409256e5a4a4"}
Jun 12 00:00:04.806958 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.806911    2575 scope.go:117] "RemoveContainer" containerID="04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d"
Jun 12 00:00:04.808230 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.808202    2575 generic.go:356] "Generic (PLEG): container finished" podID="b0c10074-ccf7-4a89-8e65-a97a423a0b5a" containerID="7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f" exitCode=0
Jun 12 00:00:04.808365 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.808233    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk" event={"ID":"b0c10074-ccf7-4a89-8e65-a97a423a0b5a","Type":"ContainerDied","Data":"7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f"}
Jun 12 00:00:04.808365 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.808257    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk"
Jun 12 00:00:04.808365 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.808266    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-8c8bk" event={"ID":"b0c10074-ccf7-4a89-8e65-a97a423a0b5a","Type":"ContainerDied","Data":"f1e7ffaf2929645f6d214efe88658a0e0eabadfa4fa8c147a77c13263cd3999b"}
Jun 12 00:00:04.816260 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.816244    2575 scope.go:117] "RemoveContainer" containerID="04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d"
Jun 12 00:00:04.816589 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:00:04.816568    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d\": container with ID starting with 04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d not found: ID does not exist" containerID="04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d"
Jun 12 00:00:04.816687 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.816599    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d"} err="failed to get container status \"04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d\": rpc error: code = NotFound desc = could not find container \"04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d\": container with ID starting with 04666952e2d8c5f3b437b910583a14b0b96623f7076bbe8a6150eec9a1394c1d not found: ID does not exist"
Jun 12 00:00:04.816687 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.816621    2575 scope.go:117] "RemoveContainer" containerID="7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f"
Jun 12 00:00:04.824011 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.823995    2575 scope.go:117] "RemoveContainer" containerID="7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f"
Jun 12 00:00:04.824268 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:00:04.824220    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f\": container with ID starting with 7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f not found: ID does not exist" containerID="7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f"
Jun 12 00:00:04.824268 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.824240    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f"} err="failed to get container status \"7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f\": rpc error: code = NotFound desc = could not find container \"7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f\": container with ID starting with 7c5e559288ee6ee95b0ccf74c6693313d1e59a8fcd41ac80e80568763ea1df6f not found: ID does not exist"
Jun 12 00:00:04.828086 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.828068    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-9jq9s"]
Jun 12 00:00:04.831591 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.831571    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-9jq9s"]
Jun 12 00:00:04.846427 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.846405    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-8c8bk"]
Jun 12 00:00:04.852823 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:04.852806    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-8c8bk"]
Jun 12 00:00:05.823374 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:05.823350    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8954adc2-a49e-45bf-ac02-6edcbabe5ed5" path="/var/lib/kubelet/pods/8954adc2-a49e-45bf-ac02-6edcbabe5ed5/volumes"
Jun 12 00:00:05.823680 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:05.823668    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c10074-ccf7-4a89-8e65-a97a423a0b5a" path="/var/lib/kubelet/pods/b0c10074-ccf7-4a89-8e65-a97a423a0b5a/volumes"
Jun 12 00:00:12.521629 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:12.521581    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 12 00:00:13.558813 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:13.558762    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 12 00:00:22.521896 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:22.521844    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jun 12 00:00:22.522357 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:22.521985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 12 00:00:23.558856 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:23.558815    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 12 00:00:23.559265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:23.558933    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 12 00:00:31.929379 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:31.929325    2575 generic.go:356] "Generic (PLEG): container finished" podID="c9261019-dc86-456f-a160-a40471808b87" containerID="6bd97cdf6031591513a32a90d1466974d41f6f400ecfbdda2bf4fefcc527a772" exitCode=137
Jun 12 00:00:31.929379 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:31.929367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerDied","Data":"6bd97cdf6031591513a32a90d1466974d41f6f400ecfbdda2bf4fefcc527a772"}
Jun 12 00:00:31.931506 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:31.931480    2575 generic.go:356] "Generic (PLEG): container finished" podID="0df8f609-5c68-414c-88a1-4201a6748259" containerID="517c2911109b9d262039c6555e8fc6869a3f52aaa269959dc499605b1a46a73a" exitCode=137
Jun 12 00:00:31.931602 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:31.931540    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerDied","Data":"517c2911109b9d262039c6555e8fc6869a3f52aaa269959dc499605b1a46a73a"}
Jun 12 00:00:32.487601 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.487581    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 12 00:00:32.513636 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.513611    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 12 00:00:32.539276 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.539253    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbbdk\" (UniqueName: \"kubernetes.io/projected/0df8f609-5c68-414c-88a1-4201a6748259-kube-api-access-sbbdk\") pod \"0df8f609-5c68-414c-88a1-4201a6748259\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") "
Jun 12 00:00:32.539410 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.539355    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0df8f609-5c68-414c-88a1-4201a6748259-feast-data\") pod \"0df8f609-5c68-414c-88a1-4201a6748259\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") "
Jun 12 00:00:32.539410 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.539390    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-registry-tls\") pod \"0df8f609-5c68-414c-88a1-4201a6748259\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") "
Jun 12 00:00:32.539499 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.539429    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls\") pod \"0df8f609-5c68-414c-88a1-4201a6748259\" (UID: \"0df8f609-5c68-414c-88a1-4201a6748259\") "
Jun 12 00:00:32.541376 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.541322    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0df8f609-5c68-414c-88a1-4201a6748259" (UID: "0df8f609-5c68-414c-88a1-4201a6748259"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:00:32.541476 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.541364    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls" (OuterVolumeSpecName: "online-tls") pod "0df8f609-5c68-414c-88a1-4201a6748259" (UID: "0df8f609-5c68-414c-88a1-4201a6748259"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:00:32.541476 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.541402    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0df8f609-5c68-414c-88a1-4201a6748259-kube-api-access-sbbdk" (OuterVolumeSpecName: "kube-api-access-sbbdk") pod "0df8f609-5c68-414c-88a1-4201a6748259" (UID: "0df8f609-5c68-414c-88a1-4201a6748259"). InnerVolumeSpecName "kube-api-access-sbbdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:00:32.547473 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.547455    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0df8f609-5c68-414c-88a1-4201a6748259-feast-data" (OuterVolumeSpecName: "feast-data") pod "0df8f609-5c68-414c-88a1-4201a6748259" (UID: "0df8f609-5c68-414c-88a1-4201a6748259"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:00:32.640083 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640014    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls\") pod \"c9261019-dc86-456f-a160-a40471808b87\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") "
Jun 12 00:00:32.640083 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640072    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls\") pod \"c9261019-dc86-456f-a160-a40471808b87\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") "
Jun 12 00:00:32.640253 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640103    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf9dm\" (UniqueName: \"kubernetes.io/projected/c9261019-dc86-456f-a160-a40471808b87-kube-api-access-bf9dm\") pod \"c9261019-dc86-456f-a160-a40471808b87\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") "
Jun 12 00:00:32.640253 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640129    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9261019-dc86-456f-a160-a40471808b87-feast-data\") pod \"c9261019-dc86-456f-a160-a40471808b87\" (UID: \"c9261019-dc86-456f-a160-a40471808b87\") "
Jun 12 00:00:32.640253 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640247    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0df8f609-5c68-414c-88a1-4201a6748259-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.640459 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640259    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.640459 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640272    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0df8f609-5c68-414c-88a1-4201a6748259-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.640459 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640285    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbbdk\" (UniqueName: \"kubernetes.io/projected/0df8f609-5c68-414c-88a1-4201a6748259-kube-api-access-sbbdk\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.640696 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.640668    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9261019-dc86-456f-a160-a40471808b87-feast-data" (OuterVolumeSpecName: "feast-data") pod "c9261019-dc86-456f-a160-a40471808b87" (UID: "c9261019-dc86-456f-a160-a40471808b87"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:00:32.641799 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.641766    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls" (OuterVolumeSpecName: "online-tls") pod "c9261019-dc86-456f-a160-a40471808b87" (UID: "c9261019-dc86-456f-a160-a40471808b87"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:00:32.641914 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.641895    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9261019-dc86-456f-a160-a40471808b87-kube-api-access-bf9dm" (OuterVolumeSpecName: "kube-api-access-bf9dm") pod "c9261019-dc86-456f-a160-a40471808b87" (UID: "c9261019-dc86-456f-a160-a40471808b87"). InnerVolumeSpecName "kube-api-access-bf9dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:00:32.642053 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.642034    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c9261019-dc86-456f-a160-a40471808b87" (UID: "c9261019-dc86-456f-a160-a40471808b87"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:00:32.740946 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.740912    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.740946 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.740944    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c9261019-dc86-456f-a160-a40471808b87-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.741080 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.740958    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf9dm\" (UniqueName: \"kubernetes.io/projected/c9261019-dc86-456f-a160-a40471808b87-kube-api-access-bf9dm\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.741080 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.740972    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c9261019-dc86-456f-a160-a40471808b87-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:00:32.938063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.938007    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"
Jun 12 00:00:32.938063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.938040    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr" event={"ID":"c9261019-dc86-456f-a160-a40471808b87","Type":"ContainerDied","Data":"14ccb6365d46edf41cc2d26c2a851f9cde7c0d4f07cdf5af7bd413666b59ea87"}
Jun 12 00:00:32.938520 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.938116    2575 scope.go:117] "RemoveContainer" containerID="9a7b9a187def23e4b099a847c815f8fea394dec089a49407625c94adef8dd71b"
Jun 12 00:00:32.940600 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.940576    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b" event={"ID":"0df8f609-5c68-414c-88a1-4201a6748259","Type":"ContainerDied","Data":"8f922ea703ac0411a825bb9bcf20990701fcf0dfa3ce06d9f3444e069ff9ad26"}
Jun 12 00:00:32.940707 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.940621    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"
Jun 12 00:00:32.950135 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.950114    2575 scope.go:117] "RemoveContainer" containerID="6bd97cdf6031591513a32a90d1466974d41f6f400ecfbdda2bf4fefcc527a772"
Jun 12 00:00:32.958501 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.958481    2575 scope.go:117] "RemoveContainer" containerID="8c15239d7760b7e703cfde3d5824c79d0aac019f7aae0989ec45864f065282dc"
Jun 12 00:00:32.964145 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.964122    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"]
Jun 12 00:00:32.966842 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.966823    2575 scope.go:117] "RemoveContainer" containerID="08f65eb119029b8b8f28539a5f5a6045e3797f7c231602a77f5e784a9a099e4f"
Jun 12 00:00:32.967504 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.967475    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-647c4f9bb-zkslr"]
Jun 12 00:00:32.974043 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.974027    2575 scope.go:117] "RemoveContainer" containerID="fb6d1e735979f8c52ee0a091dcd5b33d94a5edf66ba883c815375a1549302ac9"
Jun 12 00:00:32.978127 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.978106    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"]
Jun 12 00:00:32.981428 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.981412    2575 scope.go:117] "RemoveContainer" containerID="517c2911109b9d262039c6555e8fc6869a3f52aaa269959dc499605b1a46a73a"
Jun 12 00:00:32.982172 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.982148    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-9b5b4d5c-9qp6b"]
Jun 12 00:00:32.988549 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.988529    2575 scope.go:117] "RemoveContainer" containerID="c4cccd24ab26e05480fc643dd85fc6f6369d2b346fa7b472f956ffedd107e5cf"
Jun 12 00:00:32.995371 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:32.995348    2575 scope.go:117] "RemoveContainer" containerID="db78375fe00322c3b1f1e20c713bf204bb64ebc2fcb714073c3d2ab8652d6c78"
Jun 12 00:00:33.823680 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:33.823648    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0df8f609-5c68-414c-88a1-4201a6748259" path="/var/lib/kubelet/pods/0df8f609-5c68-414c-88a1-4201a6748259/volumes"
Jun 12 00:00:33.824161 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:33.824145    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9261019-dc86-456f-a160-a40471808b87" path="/var/lib/kubelet/pods/c9261019-dc86-456f-a160-a40471808b87/volumes"
Jun 12 00:00:35.156619 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156586    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"]
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156869    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb84980c-0b5e-4565-9311-53e0c44ade06" containerName="manager"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156880    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb84980c-0b5e-4565-9311-53e0c44ade06" containerName="manager"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156887    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c10074-ccf7-4a89-8e65-a97a423a0b5a" containerName="postgres"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156893    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c10074-ccf7-4a89-8e65-a97a423a0b5a" containerName="postgres"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156900    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156906    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156913    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="feast-init"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156918    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="feast-init"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156925    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156930    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156938    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8954adc2-a49e-45bf-ac02-6edcbabe5ed5" containerName="redis"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156943    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8954adc2-a49e-45bf-ac02-6edcbabe5ed5" containerName="redis"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156949    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="feast-apply"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156954    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="feast-apply"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156961    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156966    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156973    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="feast-init"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156978    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="feast-init"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156985    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="feast-apply"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.156991    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="feast-apply"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157000    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157004    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157051    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="online"
Jun 12 00:00:35.157048 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157058    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb84980c-0b5e-4565-9311-53e0c44ade06" containerName="manager"
Jun 12 00:00:35.157806 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157067    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8954adc2-a49e-45bf-ac02-6edcbabe5ed5" containerName="redis"
Jun 12 00:00:35.157806 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157073    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c10074-ccf7-4a89-8e65-a97a423a0b5a" containerName="postgres"
Jun 12 00:00:35.157806 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157080    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9261019-dc86-456f-a160-a40471808b87" containerName="registry"
Jun 12 00:00:35.157806 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157087    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="registry"
Jun 12 00:00:35.157806 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.157093    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0df8f609-5c68-414c-88a1-4201a6748259" containerName="online"
Jun 12 00:00:35.162569 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.162551    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.165251 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165227    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 12 00:00:35.165438 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165254    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 12 00:00:35.165548 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 12 00:00:35.165614 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165565    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 12 00:00:35.165614 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165587    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 12 00:00:35.165614 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165599    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 12 00:00:35.165764 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.165694    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lttck\""
Jun 12 00:00:35.171043 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.171021    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"]
Jun 12 00:00:35.256002 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.255973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.256110 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.256005    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277wm\" (UniqueName: \"kubernetes.io/projected/439f3aa9-c438-4941-baa8-8acdeb06ab41-kube-api-access-277wm\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.256110 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.256050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.256233 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.256118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/439f3aa9-c438-4941-baa8-8acdeb06ab41-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.256233 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.256159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.256233 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.256199    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357094 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277wm\" (UniqueName: \"kubernetes.io/projected/439f3aa9-c438-4941-baa8-8acdeb06ab41-kube-api-access-277wm\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357205 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357205 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/439f3aa9-c438-4941-baa8-8acdeb06ab41-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357205 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357393 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357393 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:00:35.357252    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 12 00:00:35.357393 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:00:35.357318    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls podName:439f3aa9-c438-4941-baa8-8acdeb06ab41 nodeName:}" failed. No retries permitted until 2026-06-12 00:00:35.85729693 +0000 UTC m=+1314.482370157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls") pod "feast-simple-feast-setup-75c64c888b-xpcjg" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 12 00:00:35.357393 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.357659 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.357633    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/439f3aa9-c438-4941-baa8-8acdeb06ab41-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.359795 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.359774    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.359883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.359804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.359883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.359875    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.366130 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.366107    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-277wm\" (UniqueName: \"kubernetes.io/projected/439f3aa9-c438-4941-baa8-8acdeb06ab41-kube-api-access-277wm\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.862222 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.862195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:35.864327 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:35.864305    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xpcjg\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:36.072531 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:36.072508    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:00:36.205558 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:36.205533    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"]
Jun 12 00:00:36.207172 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:00:36.207150    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod439f3aa9_c438_4941_baa8_8acdeb06ab41.slice/crio-6b6220c6ef1aa48173e483960c2e7e60207b93ac0ce91db6e93dd0747d97a9e0 WatchSource:0}: Error finding container 6b6220c6ef1aa48173e483960c2e7e60207b93ac0ce91db6e93dd0747d97a9e0: Status 404 returned error can't find the container with id 6b6220c6ef1aa48173e483960c2e7e60207b93ac0ce91db6e93dd0747d97a9e0
Jun 12 00:00:36.209019 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:36.209001    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 12 00:00:36.960929 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:36.960896    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"6b6220c6ef1aa48173e483960c2e7e60207b93ac0ce91db6e93dd0747d97a9e0"}
Jun 12 00:00:53.035552 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:53.035520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"7229a20ea714529198893b378dac713ca2cba2aa5ec398fda85cb398a3ef1505"}
Jun 12 00:00:58.056322 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:58.056254    2575 generic.go:356] "Generic (PLEG): container finished" podID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerID="7229a20ea714529198893b378dac713ca2cba2aa5ec398fda85cb398a3ef1505" exitCode=0
Jun 12 00:00:58.056322 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:58.056314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"7229a20ea714529198893b378dac713ca2cba2aa5ec398fda85cb398a3ef1505"}
Jun 12 00:00:59.062388 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:00:59.062353    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"d689f2a02f76244cf35394af92a8ebf226a904dd90b0efeb632da385fb14fff1"}
Jun 12 00:01:04.084738 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:04.084706    2575 generic.go:356] "Generic (PLEG): container finished" podID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerID="d689f2a02f76244cf35394af92a8ebf226a904dd90b0efeb632da385fb14fff1" exitCode=0
Jun 12 00:01:04.085100 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:04.084783    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"d689f2a02f76244cf35394af92a8ebf226a904dd90b0efeb632da385fb14fff1"}
Jun 12 00:01:05.094903 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:05.094851    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"a0ef696453b2f0d8ad6e79629994928635027d4a7330a68eb98e1cc0d2cb1402"}
Jun 12 00:01:05.095404 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:05.094912    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"a125d36fd684272c41a3a6eab5838fbc6d781bf12475f344f3c043fb8a106691"}
Jun 12 00:01:05.095404 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:05.094934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"879424242b5d0fca0d4cc9ae7eca71338cc3ac608e0da83bf699652158f15d03"}
Jun 12 00:01:05.095404 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:05.094953    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerStarted","Data":"61699a247c0e06bab87d84c547284718758dcebaab9d004932a37cb79c5ab39b"}
Jun 12 00:01:05.121618 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:05.121550    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podStartSLOduration=13.693205912 podStartE2EDuration="30.121528985s" totalImagesPullingTime="16.428323073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:01:05.119712188 +0000 UTC m=+1343.744785422" watchObservedRunningTime="2026-06-12 00:01:05.121528985 +0000 UTC m=+1343.746602222"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.072886    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.072946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.072966    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.072984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.073002    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.073020    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.073036    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.073085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.073053    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:06.074741 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.074705    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Jun 12 00:01:06.074741 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.074722    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jun 12 00:01:06.074926 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.074777    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 12 00:01:06.075033 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:06.075000    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 12 00:01:09.073274 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:09.073218    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Jun 12 00:01:09.073897 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:09.073218    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 12 00:01:09.073897 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:09.073229    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 12 00:01:09.073897 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:09.073217    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jun 12 00:01:12.074265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.074235    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.074623 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.074389    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.074623 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.074506    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.075196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.075171    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.075313 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.075248    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.075313 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.075287    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.078278 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.078258    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:01:12.133492 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:01:12.133467    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:02:14.913195 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:14.913164    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"]
Jun 12 00:02:14.913661 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:14.913458    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui" containerID="cri-o://a0ef696453b2f0d8ad6e79629994928635027d4a7330a68eb98e1cc0d2cb1402" gracePeriod=30
Jun 12 00:02:14.913661 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:14.913494    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online" containerID="cri-o://879424242b5d0fca0d4cc9ae7eca71338cc3ac608e0da83bf699652158f15d03" gracePeriod=30
Jun 12 00:02:14.913661 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:14.913409    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="registry" containerID="cri-o://61699a247c0e06bab87d84c547284718758dcebaab9d004932a37cb79c5ab39b" gracePeriod=30
Jun 12 00:02:14.913834 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:14.913459    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="offline" containerID="cri-o://a125d36fd684272c41a3a6eab5838fbc6d781bf12475f344f3c043fb8a106691" gracePeriod=30
Jun 12 00:02:15.203183 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.203102    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"]
Jun 12 00:02:15.205724 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.205705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.208410 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.208388    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rn67k\""
Jun 12 00:02:15.218782 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.218760    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"]
Jun 12 00:02:15.283973 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.283931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmr8\" (UniqueName: \"kubernetes.io/projected/5ef3966e-bbc3-4844-95b2-3423fedbb393-kube-api-access-vzmr8\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.284148 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.283989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.284148 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.284095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.284148 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.284130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.284283 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.284209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef3966e-bbc3-4844-95b2-3423fedbb393-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.284283 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.284242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385013 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.384988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmr8\" (UniqueName: \"kubernetes.io/projected/5ef3966e-bbc3-4844-95b2-3423fedbb393-kube-api-access-vzmr8\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385166 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.385018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385166 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.385053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385287 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.385160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385287 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.385229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef3966e-bbc3-4844-95b2-3423fedbb393-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385287 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.385276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.385458 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:02:15.385411    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 12 00:02:15.385514 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:02:15.385471    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls podName:5ef3966e-bbc3-4844-95b2-3423fedbb393 nodeName:}" failed. No retries permitted until 2026-06-12 00:02:15.885450235 +0000 UTC m=+1414.510523451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls") pod "feast-simple-feast-setup-75c64c888b-gd5zh" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393") : secret "feast-simple-feast-setup-online-tls" not found
Jun 12 00:02:15.385677 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.385652    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef3966e-bbc3-4844-95b2-3423fedbb393-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.387450 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.387421    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.387578 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.387555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.387764 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.387750    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.398530 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.394370    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmr8\" (UniqueName: \"kubernetes.io/projected/5ef3966e-bbc3-4844-95b2-3423fedbb393-kube-api-access-vzmr8\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.889245 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.889176    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:15.891233 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:15.891214    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-gd5zh\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:16.114178 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.114147    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:16.242305 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.242275    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"]
Jun 12 00:02:16.243655 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:02:16.243631    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ef3966e_bbc3_4844_95b2_3423fedbb393.slice/crio-739970c6609f986a221dc831e6a20fd42f39dfac8059952adc60b430c11fbf3c WatchSource:0}: Error finding container 739970c6609f986a221dc831e6a20fd42f39dfac8059952adc60b430c11fbf3c: Status 404 returned error can't find the container with id 739970c6609f986a221dc831e6a20fd42f39dfac8059952adc60b430c11fbf3c
Jun 12 00:02:16.369387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.369325    2575 generic.go:356] "Generic (PLEG): container finished" podID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerID="a0ef696453b2f0d8ad6e79629994928635027d4a7330a68eb98e1cc0d2cb1402" exitCode=0
Jun 12 00:02:16.369387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.369370    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"a0ef696453b2f0d8ad6e79629994928635027d4a7330a68eb98e1cc0d2cb1402"}
Jun 12 00:02:16.369387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.369386    2575 generic.go:356] "Generic (PLEG): container finished" podID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerID="879424242b5d0fca0d4cc9ae7eca71338cc3ac608e0da83bf699652158f15d03" exitCode=0
Jun 12 00:02:16.369647 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.369418    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"879424242b5d0fca0d4cc9ae7eca71338cc3ac608e0da83bf699652158f15d03"}
Jun 12 00:02:16.370918 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.370897    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"26c3734bf44170fec21b9024b79962db352ad5b3c938f4fce4b3151bb478d758"}
Jun 12 00:02:16.371073 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:16.370930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"739970c6609f986a221dc831e6a20fd42f39dfac8059952adc60b430c11fbf3c"}
Jun 12 00:02:21.393702 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:21.393669    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerID="26c3734bf44170fec21b9024b79962db352ad5b3c938f4fce4b3151bb478d758" exitCode=0
Jun 12 00:02:21.394075 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:21.393718    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"26c3734bf44170fec21b9024b79962db352ad5b3c938f4fce4b3151bb478d758"}
Jun 12 00:02:22.075752 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:22.075706    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 12 00:02:22.131619 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:22.131587    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 12 00:02:22.401789 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:22.401704    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"db2271ed846016d6575dd2c640d746139ca8f02922fc1ae31462757442cf153d"}
Jun 12 00:02:27.422103 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:27.422073    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerID="db2271ed846016d6575dd2c640d746139ca8f02922fc1ae31462757442cf153d" exitCode=0
Jun 12 00:02:27.422489 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:27.422121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"db2271ed846016d6575dd2c640d746139ca8f02922fc1ae31462757442cf153d"}
Jun 12 00:02:28.433136 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:28.433093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"b8f7031d43d506017c47416582ae29696806c9ac61a7fba3719a6a3ec41bca07"}
Jun 12 00:02:28.433662 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:28.433155    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"4f63644ecc27dd542410e4591ddd7333c8b1b9e76666e6f98bd87736c1e441fd"}
Jun 12 00:02:28.433662 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:28.433177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"c0f2b7edf0e7a04dd3df30200769e8790825559d6308b943a24a934dee027865"}
Jun 12 00:02:28.433662 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:28.433195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerStarted","Data":"ec59bd860185a0b9b2b7e71b4b0ab89d0753e0e9e80b58607077eb35db0e64e8"}
Jun 12 00:02:28.458797 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:28.458738    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podStartSLOduration=13.458715368 podStartE2EDuration="13.458715368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:02:28.455699932 +0000 UTC m=+1427.080773177" watchObservedRunningTime="2026-06-12 00:02:28.458715368 +0000 UTC m=+1427.083788602"
Jun 12 00:02:31.114630 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.114537    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:31.115944 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.115915    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:31.116081 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.115985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:31.116081 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.116005    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:31.116758 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.116728    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Jun 12 00:02:31.116898 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.116756    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 12 00:02:31.117032 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.116790    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Jun 12 00:02:31.117032 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:31.116812    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 12 00:02:32.076188 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:32.076137    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 12 00:02:32.130965 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:32.130919    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 12 00:02:34.115059 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.115029    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.115586 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.115567    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.115652 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.115606    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.115788 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.115770    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.115846 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.115825    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.119831 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.119810    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.466947 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.466923    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.467125 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.467005    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.467125 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.467026    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.467403 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.467382    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.467516 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.467496    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:34.469912 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:34.469893    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:02:42.075062 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:42.075020    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 12 00:02:42.075548 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:42.075164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:02:42.130911 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:42.130867    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 12 00:02:42.131058 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:42.131020    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:02:45.516078 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.516051    2575 generic.go:356] "Generic (PLEG): container finished" podID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerID="a125d36fd684272c41a3a6eab5838fbc6d781bf12475f344f3c043fb8a106691" exitCode=137
Jun 12 00:02:45.516078 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.516075    2575 generic.go:356] "Generic (PLEG): container finished" podID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerID="61699a247c0e06bab87d84c547284718758dcebaab9d004932a37cb79c5ab39b" exitCode=137
Jun 12 00:02:45.516447 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.516116    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"a125d36fd684272c41a3a6eab5838fbc6d781bf12475f344f3c043fb8a106691"}
Jun 12 00:02:45.516447 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.516162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"61699a247c0e06bab87d84c547284718758dcebaab9d004932a37cb79c5ab39b"}
Jun 12 00:02:45.563010 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.562992    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:02:45.640259 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640236    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/439f3aa9-c438-4941-baa8-8acdeb06ab41-feast-data\") pod \"439f3aa9-c438-4941-baa8-8acdeb06ab41\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") "
Jun 12 00:02:45.640408 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640281    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls\") pod \"439f3aa9-c438-4941-baa8-8acdeb06ab41\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") "
Jun 12 00:02:45.640408 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640319    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-277wm\" (UniqueName: \"kubernetes.io/projected/439f3aa9-c438-4941-baa8-8acdeb06ab41-kube-api-access-277wm\") pod \"439f3aa9-c438-4941-baa8-8acdeb06ab41\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") "
Jun 12 00:02:45.640408 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640386    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-ui-tls\") pod \"439f3aa9-c438-4941-baa8-8acdeb06ab41\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") "
Jun 12 00:02:45.640571 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640419    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-offline-tls\") pod \"439f3aa9-c438-4941-baa8-8acdeb06ab41\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") "
Jun 12 00:02:45.640571 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640450    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-online-tls\") pod \"439f3aa9-c438-4941-baa8-8acdeb06ab41\" (UID: \"439f3aa9-c438-4941-baa8-8acdeb06ab41\") "
Jun 12 00:02:45.640755 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.640725    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/439f3aa9-c438-4941-baa8-8acdeb06ab41-feast-data" (OuterVolumeSpecName: "feast-data") pod "439f3aa9-c438-4941-baa8-8acdeb06ab41" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:02:45.642670 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.642643    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "439f3aa9-c438-4941-baa8-8acdeb06ab41" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:02:45.642773 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.642687    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-online-tls" (OuterVolumeSpecName: "online-tls") pod "439f3aa9-c438-4941-baa8-8acdeb06ab41" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:02:45.642829 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.642778    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/439f3aa9-c438-4941-baa8-8acdeb06ab41-kube-api-access-277wm" (OuterVolumeSpecName: "kube-api-access-277wm") pod "439f3aa9-c438-4941-baa8-8acdeb06ab41" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41"). InnerVolumeSpecName "kube-api-access-277wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:02:45.642829 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.642818    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "439f3aa9-c438-4941-baa8-8acdeb06ab41" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:02:45.642900 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.642850    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "439f3aa9-c438-4941-baa8-8acdeb06ab41" (UID: "439f3aa9-c438-4941-baa8-8acdeb06ab41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:02:45.741288 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.741257    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:02:45.741288 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.741288    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:02:45.741288 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.741298    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:02:45.741469 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.741306    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/439f3aa9-c438-4941-baa8-8acdeb06ab41-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:02:45.741469 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.741314    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/439f3aa9-c438-4941-baa8-8acdeb06ab41-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:02:45.741469 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:45.741323    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-277wm\" (UniqueName: \"kubernetes.io/projected/439f3aa9-c438-4941-baa8-8acdeb06ab41-kube-api-access-277wm\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:02:46.523813 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.523780    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg" event={"ID":"439f3aa9-c438-4941-baa8-8acdeb06ab41","Type":"ContainerDied","Data":"6b6220c6ef1aa48173e483960c2e7e60207b93ac0ce91db6e93dd0747d97a9e0"}
Jun 12 00:02:46.524193 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.523837    2575 scope.go:117] "RemoveContainer" containerID="a0ef696453b2f0d8ad6e79629994928635027d4a7330a68eb98e1cc0d2cb1402"
Jun 12 00:02:46.524193 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.523794    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"
Jun 12 00:02:46.533118 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.533101    2575 scope.go:117] "RemoveContainer" containerID="a125d36fd684272c41a3a6eab5838fbc6d781bf12475f344f3c043fb8a106691"
Jun 12 00:02:46.540945 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.540928    2575 scope.go:117] "RemoveContainer" containerID="879424242b5d0fca0d4cc9ae7eca71338cc3ac608e0da83bf699652158f15d03"
Jun 12 00:02:46.544959 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.544923    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"]
Jun 12 00:02:46.549659 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.549633    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xpcjg"]
Jun 12 00:02:46.550129 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.550113    2575 scope.go:117] "RemoveContainer" containerID="61699a247c0e06bab87d84c547284718758dcebaab9d004932a37cb79c5ab39b"
Jun 12 00:02:46.557620 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.557601    2575 scope.go:117] "RemoveContainer" containerID="d689f2a02f76244cf35394af92a8ebf226a904dd90b0efeb632da385fb14fff1"
Jun 12 00:02:46.564400 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:46.564381    2575 scope.go:117] "RemoveContainer" containerID="7229a20ea714529198893b378dac713ca2cba2aa5ec398fda85cb398a3ef1505"
Jun 12 00:02:47.823538 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:02:47.823505    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" path="/var/lib/kubelet/pods/439f3aa9-c438-4941-baa8-8acdeb06ab41/volumes"
Jun 12 00:03:36.947881 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.947850    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"]
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948155    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="offline"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948167    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="offline"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948179    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="feast-init"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948185    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="feast-init"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948192    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948198    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948206    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948211    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948224    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="registry"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948229    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="registry"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948236    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="feast-apply"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948240    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="feast-apply"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948299    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="offline"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948309    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="registry"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948316    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="ui"
Jun 12 00:03:36.948355 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.948321    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="439f3aa9-c438-4941-baa8-8acdeb06ab41" containerName="online"
Jun 12 00:03:36.950971 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.950954    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:36.953453 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.953428    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 12 00:03:36.953563 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.953430    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 12 00:03:36.953563 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.953525    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 12 00:03:36.953757 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.953742    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 12 00:03:36.953818 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.953770    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-drmdf\""
Jun 12 00:03:36.953858 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.953820    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 12 00:03:36.954573 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.954558    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 12 00:03:36.962857 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:36.962834    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"]
Jun 12 00:03:37.017100 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.017075    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.017188 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.017112    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.017188 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.017131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0c3807a-427e-4b93-83f6-37f73879907a-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.017188 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.017151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbc9q\" (UniqueName: \"kubernetes.io/projected/f0c3807a-427e-4b93-83f6-37f73879907a-kube-api-access-cbc9q\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.017188 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.017176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.017372 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.017205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0c3807a-427e-4b93-83f6-37f73879907a-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117540 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.117516    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbc9q\" (UniqueName: \"kubernetes.io/projected/f0c3807a-427e-4b93-83f6-37f73879907a-kube-api-access-cbc9q\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117638 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.117549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117638 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.117576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0c3807a-427e-4b93-83f6-37f73879907a-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117638 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.117622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117815 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.117660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117815 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.117687    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0c3807a-427e-4b93-83f6-37f73879907a-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.117815 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:03:37.117796    2575 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 12 00:03:37.117815 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:03:37.117808    2575 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 12 00:03:37.118022 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:03:37.117857    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls podName:f0c3807a-427e-4b93-83f6-37f73879907a nodeName:}" failed. No retries permitted until 2026-06-12 00:03:37.617838144 +0000 UTC m=+1496.242911369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-ml95p" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 12 00:03:37.118022 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:03:37.117878    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls podName:f0c3807a-427e-4b93-83f6-37f73879907a nodeName:}" failed. No retries permitted until 2026-06-12 00:03:37.617866345 +0000 UTC m=+1496.242939557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-ml95p" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 12 00:03:37.118128 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.118025    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0c3807a-427e-4b93-83f6-37f73879907a-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.118296 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.118279    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0c3807a-427e-4b93-83f6-37f73879907a-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.119908 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.119889    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.127891 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.127869    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbc9q\" (UniqueName: \"kubernetes.io/projected/f0c3807a-427e-4b93-83f6-37f73879907a-kube-api-access-cbc9q\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.628058 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.628024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.628225 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.628072    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.630511 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.630491    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.630585 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.630510    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-ml95p\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.860353 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.860307    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:37.993987 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:37.993963    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"]
Jun 12 00:03:37.995137 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:03:37.995115    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0c3807a_427e_4b93_83f6_37f73879907a.slice/crio-020bcc19d8e27c3c3c7fbed3709ba6f1d2c304efc44e4ce2419f47ab76c84dd1 WatchSource:0}: Error finding container 020bcc19d8e27c3c3c7fbed3709ba6f1d2c304efc44e4ce2419f47ab76c84dd1: Status 404 returned error can't find the container with id 020bcc19d8e27c3c3c7fbed3709ba6f1d2c304efc44e4ce2419f47ab76c84dd1
Jun 12 00:03:38.738408 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:38.738365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerStarted","Data":"04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de"}
Jun 12 00:03:38.738579 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:38.738429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerStarted","Data":"020bcc19d8e27c3c3c7fbed3709ba6f1d2c304efc44e4ce2419f47ab76c84dd1"}
Jun 12 00:03:41.950659 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:41.950628    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 12 00:03:41.958229 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:41.958202    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 12 00:03:41.962120 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:41.962096    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 12 00:03:41.963201 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:41.963180    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 12 00:03:42.756996 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:42.756965    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0c3807a-427e-4b93-83f6-37f73879907a" containerID="04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de" exitCode=0
Jun 12 00:03:42.757175 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:42.757024    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerDied","Data":"04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de"}
Jun 12 00:03:43.762959 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:43.762930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerStarted","Data":"bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c"}
Jun 12 00:03:48.785413 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:48.785376    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0c3807a-427e-4b93-83f6-37f73879907a" containerID="bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c" exitCode=0
Jun 12 00:03:48.785804 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:48.785450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerDied","Data":"bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c"}
Jun 12 00:03:49.795190 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.795153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerStarted","Data":"fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056"}
Jun 12 00:03:49.795594 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.795216    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerStarted","Data":"011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd"}
Jun 12 00:03:49.795594 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.795238    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerStarted","Data":"47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e"}
Jun 12 00:03:49.818219 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.818136    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podStartSLOduration=13.818120899 podStartE2EDuration="13.818120899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:03:49.8156826 +0000 UTC m=+1508.440755848" watchObservedRunningTime="2026-06-12 00:03:49.818120899 +0000 UTC m=+1508.443194131"
Jun 12 00:03:49.861109 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.861076    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:49.861278 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.861129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:49.861278 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.861149    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:49.863153 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.863116    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jun 12 00:03:49.863265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.863145    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 12 00:03:49.863265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:49.863180    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 12 00:03:52.860651 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:52.860602    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 12 00:03:52.861172 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:52.860651    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 12 00:03:52.861172 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:52.860650    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jun 12 00:03:55.861385 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.861324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:55.861878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.861583    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:55.861878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.861809    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:55.861878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.861844    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:55.862066 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.862049    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:55.862126 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.862097    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:55.865829 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:55.865809    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:56.828646 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:56.828612    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:03:56.831639 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:03:56.831607    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:04:58.470663 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.470624    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"]
Jun 12 00:04:58.472265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.470877    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online" containerID="cri-o://47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e" gracePeriod=30
Jun 12 00:04:58.472265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.470904    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="offline" containerID="cri-o://011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd" gracePeriod=30
Jun 12 00:04:58.472265 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.470968    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui" containerID="cri-o://fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056" gracePeriod=30
Jun 12 00:04:58.603814 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.603779    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"]
Jun 12 00:04:58.604102 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.604066    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="registry" containerID="cri-o://ec59bd860185a0b9b2b7e71b4b0ab89d0753e0e9e80b58607077eb35db0e64e8" gracePeriod=30
Jun 12 00:04:58.604201 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.604108    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui" containerID="cri-o://b8f7031d43d506017c47416582ae29696806c9ac61a7fba3719a6a3ec41bca07" gracePeriod=30
Jun 12 00:04:58.604201 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.604154    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online" containerID="cri-o://c0f2b7edf0e7a04dd3df30200769e8790825559d6308b943a24a934dee027865" gracePeriod=30
Jun 12 00:04:58.604303 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:58.604117    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="offline" containerID="cri-o://4f63644ecc27dd542410e4591ddd7333c8b1b9e76666e6f98bd87736c1e441fd" gracePeriod=30
Jun 12 00:04:59.099296 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:59.099255    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerID="b8f7031d43d506017c47416582ae29696806c9ac61a7fba3719a6a3ec41bca07" exitCode=0
Jun 12 00:04:59.099492 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:59.099325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"b8f7031d43d506017c47416582ae29696806c9ac61a7fba3719a6a3ec41bca07"}
Jun 12 00:04:59.102112 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:59.102089    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0c3807a-427e-4b93-83f6-37f73879907a" containerID="fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056" exitCode=0
Jun 12 00:04:59.102229 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:04:59.102120    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerDied","Data":"fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056"}
Jun 12 00:05:00.108434 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:00.108407    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerID="c0f2b7edf0e7a04dd3df30200769e8790825559d6308b943a24a934dee027865" exitCode=0
Jun 12 00:05:00.108800 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:00.108479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"c0f2b7edf0e7a04dd3df30200769e8790825559d6308b943a24a934dee027865"}
Jun 12 00:05:00.110909 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:00.110889    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0c3807a-427e-4b93-83f6-37f73879907a" containerID="47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e" exitCode=0
Jun 12 00:05:00.111016 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:00.110930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerDied","Data":"47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e"}
Jun 12 00:05:04.467479 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:04.467432    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 12 00:05:04.467865 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:04.467517    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 12 00:05:05.862508 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:05.862471    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 12 00:05:06.829196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:06.829159    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 12 00:05:14.467282 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:14.467243    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 12 00:05:14.467764 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:14.467277    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 12 00:05:15.861890 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:15.861855    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 12 00:05:16.829687 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:16.829656    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 12 00:05:24.467602 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:24.467552    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 12 00:05:24.467602 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:24.467552    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 12 00:05:24.468036 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:24.467691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:05:24.468036 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:24.467750    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:05:25.861921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:25.861885    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 12 00:05:25.862289 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:25.861991    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:05:26.829502 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:26.829472    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 12 00:05:26.829662 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:26.829570    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:05:29.118299 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.118281    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:05:29.223921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.222888    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-offline-tls\") pod \"f0c3807a-427e-4b93-83f6-37f73879907a\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") "
Jun 12 00:05:29.223921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.222962    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls\") pod \"f0c3807a-427e-4b93-83f6-37f73879907a\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") "
Jun 12 00:05:29.223921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.223011    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls\") pod \"f0c3807a-427e-4b93-83f6-37f73879907a\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") "
Jun 12 00:05:29.223921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.223041    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0c3807a-427e-4b93-83f6-37f73879907a-registry-tls\") pod \"f0c3807a-427e-4b93-83f6-37f73879907a\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") "
Jun 12 00:05:29.223921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.223083    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0c3807a-427e-4b93-83f6-37f73879907a-feast-data\") pod \"f0c3807a-427e-4b93-83f6-37f73879907a\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") "
Jun 12 00:05:29.223921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.223142    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbc9q\" (UniqueName: \"kubernetes.io/projected/f0c3807a-427e-4b93-83f6-37f73879907a-kube-api-access-cbc9q\") pod \"f0c3807a-427e-4b93-83f6-37f73879907a\" (UID: \"f0c3807a-427e-4b93-83f6-37f73879907a\") "
Jun 12 00:05:29.225221 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.225189    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0c3807a-427e-4b93-83f6-37f73879907a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0c3807a-427e-4b93-83f6-37f73879907a" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 12 00:05:29.225419 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.225381    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0c3807a-427e-4b93-83f6-37f73879907a-feast-data" (OuterVolumeSpecName: "feast-data") pod "f0c3807a-427e-4b93-83f6-37f73879907a" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:05:29.227867 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.227808    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f0c3807a-427e-4b93-83f6-37f73879907a" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.228125 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.228076    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f0c3807a-427e-4b93-83f6-37f73879907a" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.228125 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.228097    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c3807a-427e-4b93-83f6-37f73879907a-kube-api-access-cbc9q" (OuterVolumeSpecName: "kube-api-access-cbc9q") pod "f0c3807a-427e-4b93-83f6-37f73879907a" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a"). InnerVolumeSpecName "kube-api-access-cbc9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:05:29.229182 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.229158    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls" (OuterVolumeSpecName: "online-tls") pod "f0c3807a-427e-4b93-83f6-37f73879907a" (UID: "f0c3807a-427e-4b93-83f6-37f73879907a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.229741 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.229710    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerID="4f63644ecc27dd542410e4591ddd7333c8b1b9e76666e6f98bd87736c1e441fd" exitCode=137
Jun 12 00:05:29.229836 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.229742    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerID="ec59bd860185a0b9b2b7e71b4b0ab89d0753e0e9e80b58607077eb35db0e64e8" exitCode=137
Jun 12 00:05:29.229836 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.229782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"4f63644ecc27dd542410e4591ddd7333c8b1b9e76666e6f98bd87736c1e441fd"}
Jun 12 00:05:29.229836 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.229825    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"ec59bd860185a0b9b2b7e71b4b0ab89d0753e0e9e80b58607077eb35db0e64e8"}
Jun 12 00:05:29.232459 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.232438    2575 generic.go:356] "Generic (PLEG): container finished" podID="f0c3807a-427e-4b93-83f6-37f73879907a" containerID="011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd" exitCode=137
Jun 12 00:05:29.232555 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.232516    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"
Jun 12 00:05:29.232555 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.232519    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerDied","Data":"011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd"}
Jun 12 00:05:29.232663 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.232562    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p" event={"ID":"f0c3807a-427e-4b93-83f6-37f73879907a","Type":"ContainerDied","Data":"020bcc19d8e27c3c3c7fbed3709ba6f1d2c304efc44e4ce2419f47ab76c84dd1"}
Jun 12 00:05:29.232663 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.232587    2575 scope.go:117] "RemoveContainer" containerID="fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056"
Jun 12 00:05:29.241429 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.241408    2575 scope.go:117] "RemoveContainer" containerID="011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd"
Jun 12 00:05:29.245690 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.245673    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:05:29.248954 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.248936    2575 scope.go:117] "RemoveContainer" containerID="47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e"
Jun 12 00:05:29.256387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.256371    2575 scope.go:117] "RemoveContainer" containerID="bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c"
Jun 12 00:05:29.257764 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.257740    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"]
Jun 12 00:05:29.262659 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.262640    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-ml95p"]
Jun 12 00:05:29.264721 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.264705    2575 scope.go:117] "RemoveContainer" containerID="04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de"
Jun 12 00:05:29.271292 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.271276    2575 scope.go:117] "RemoveContainer" containerID="fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056"
Jun 12 00:05:29.271562 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:05:29.271543    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056\": container with ID starting with fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056 not found: ID does not exist" containerID="fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056"
Jun 12 00:05:29.271625 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.271569    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056"} err="failed to get container status \"fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056\": rpc error: code = NotFound desc = could not find container \"fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056\": container with ID starting with fbf6f1a868f01b55e47e51ea16c49ae5f8e2d2410bc3ba474a36cff7f71b2056 not found: ID does not exist"
Jun 12 00:05:29.271625 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.271585    2575 scope.go:117] "RemoveContainer" containerID="011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd"
Jun 12 00:05:29.271832 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:05:29.271816    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd\": container with ID starting with 011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd not found: ID does not exist" containerID="011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd"
Jun 12 00:05:29.271881 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.271837    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd"} err="failed to get container status \"011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd\": rpc error: code = NotFound desc = could not find container \"011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd\": container with ID starting with 011b0c7bd43804de98e86d20485be47ffa9b6e8b1ff954b81d6ebf4792a351bd not found: ID does not exist"
Jun 12 00:05:29.271881 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.271851    2575 scope.go:117] "RemoveContainer" containerID="47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e"
Jun 12 00:05:29.272065 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:05:29.272048    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e\": container with ID starting with 47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e not found: ID does not exist" containerID="47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e"
Jun 12 00:05:29.272117 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.272069    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e"} err="failed to get container status \"47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e\": rpc error: code = NotFound desc = could not find container \"47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e\": container with ID starting with 47ea182ed5295b92f70d5edf1b4a54a3a1fc9481aa7f532c029ea5d5bc36c00e not found: ID does not exist"
Jun 12 00:05:29.272117 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.272082    2575 scope.go:117] "RemoveContainer" containerID="bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c"
Jun 12 00:05:29.272280 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:05:29.272257    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c\": container with ID starting with bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c not found: ID does not exist" containerID="bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c"
Jun 12 00:05:29.272320 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.272282    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c"} err="failed to get container status \"bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c\": rpc error: code = NotFound desc = could not find container \"bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c\": container with ID starting with bc3bc2808d42eeb5ef564e4c0666a22b1d3233c945e4ecd577b70060837b664c not found: ID does not exist"
Jun 12 00:05:29.272320 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.272294    2575 scope.go:117] "RemoveContainer" containerID="04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de"
Jun 12 00:05:29.272548 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:05:29.272529    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de\": container with ID starting with 04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de not found: ID does not exist" containerID="04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de"
Jun 12 00:05:29.272593 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.272555    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de"} err="failed to get container status \"04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de\": rpc error: code = NotFound desc = could not find container \"04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de\": container with ID starting with 04a3ae2a2fd186800c8c009024e8bbae8eef6abf431c4919a89af21a4567f0de not found: ID does not exist"
Jun 12 00:05:29.324280 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.324260    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.324280 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.324278    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f0c3807a-427e-4b93-83f6-37f73879907a-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.324487 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.324288    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f0c3807a-427e-4b93-83f6-37f73879907a-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.324487 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.324297    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbc9q\" (UniqueName: \"kubernetes.io/projected/f0c3807a-427e-4b93-83f6-37f73879907a-kube-api-access-cbc9q\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.324487 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.324304    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.324487 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.324313    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f0c3807a-427e-4b93-83f6-37f73879907a-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.424885 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.424863    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-registry-tls\") pod \"5ef3966e-bbc3-4844-95b2-3423fedbb393\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") "
Jun 12 00:05:29.424976 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.424899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef3966e-bbc3-4844-95b2-3423fedbb393-feast-data\") pod \"5ef3966e-bbc3-4844-95b2-3423fedbb393\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") "
Jun 12 00:05:29.424976 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.424926    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzmr8\" (UniqueName: \"kubernetes.io/projected/5ef3966e-bbc3-4844-95b2-3423fedbb393-kube-api-access-vzmr8\") pod \"5ef3966e-bbc3-4844-95b2-3423fedbb393\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") "
Jun 12 00:05:29.425060 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.424977    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-ui-tls\") pod \"5ef3966e-bbc3-4844-95b2-3423fedbb393\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") "
Jun 12 00:05:29.425060 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.425019    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-offline-tls\") pod \"5ef3966e-bbc3-4844-95b2-3423fedbb393\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") "
Jun 12 00:05:29.425060 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.425055    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls\") pod \"5ef3966e-bbc3-4844-95b2-3423fedbb393\" (UID: \"5ef3966e-bbc3-4844-95b2-3423fedbb393\") "
Jun 12 00:05:29.425462 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.425433    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ef3966e-bbc3-4844-95b2-3423fedbb393-feast-data" (OuterVolumeSpecName: "feast-data") pod "5ef3966e-bbc3-4844-95b2-3423fedbb393" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:05:29.426884 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.426859    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef3966e-bbc3-4844-95b2-3423fedbb393-kube-api-access-vzmr8" (OuterVolumeSpecName: "kube-api-access-vzmr8") pod "5ef3966e-bbc3-4844-95b2-3423fedbb393" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393"). InnerVolumeSpecName "kube-api-access-vzmr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:05:29.426962 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.426950    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls" (OuterVolumeSpecName: "online-tls") pod "5ef3966e-bbc3-4844-95b2-3423fedbb393" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.427014 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.426963    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5ef3966e-bbc3-4844-95b2-3423fedbb393" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.427294 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.427276    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5ef3966e-bbc3-4844-95b2-3423fedbb393" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.427368 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.427295    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ef3966e-bbc3-4844-95b2-3423fedbb393" (UID: "5ef3966e-bbc3-4844-95b2-3423fedbb393"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:05:29.526078 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.526030    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.526078 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.526051    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.526078 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.526063    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.526078 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.526073    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef3966e-bbc3-4844-95b2-3423fedbb393-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.526250 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.526086    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzmr8\" (UniqueName: \"kubernetes.io/projected/5ef3966e-bbc3-4844-95b2-3423fedbb393-kube-api-access-vzmr8\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.526250 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.526097    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5ef3966e-bbc3-4844-95b2-3423fedbb393-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:05:29.823716 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:29.823665    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" path="/var/lib/kubelet/pods/f0c3807a-427e-4b93-83f6-37f73879907a/volumes"
Jun 12 00:05:30.238477 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.238455    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"
Jun 12 00:05:30.238825 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.238450    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh" event={"ID":"5ef3966e-bbc3-4844-95b2-3423fedbb393","Type":"ContainerDied","Data":"739970c6609f986a221dc831e6a20fd42f39dfac8059952adc60b430c11fbf3c"}
Jun 12 00:05:30.238825 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.238577    2575 scope.go:117] "RemoveContainer" containerID="b8f7031d43d506017c47416582ae29696806c9ac61a7fba3719a6a3ec41bca07"
Jun 12 00:05:30.246229 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.246214    2575 scope.go:117] "RemoveContainer" containerID="4f63644ecc27dd542410e4591ddd7333c8b1b9e76666e6f98bd87736c1e441fd"
Jun 12 00:05:30.253177 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.253161    2575 scope.go:117] "RemoveContainer" containerID="c0f2b7edf0e7a04dd3df30200769e8790825559d6308b943a24a934dee027865"
Jun 12 00:05:30.260276 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.260245    2575 scope.go:117] "RemoveContainer" containerID="ec59bd860185a0b9b2b7e71b4b0ab89d0753e0e9e80b58607077eb35db0e64e8"
Jun 12 00:05:30.261593 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.261576    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"]
Jun 12 00:05:30.267029 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.267011    2575 scope.go:117] "RemoveContainer" containerID="db2271ed846016d6575dd2c640d746139ca8f02922fc1ae31462757442cf153d"
Jun 12 00:05:30.272845 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.272827    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-gd5zh"]
Jun 12 00:05:30.273856 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:30.273838    2575 scope.go:117] "RemoveContainer" containerID="26c3734bf44170fec21b9024b79962db352ad5b3c938f4fce4b3151bb478d758"
Jun 12 00:05:31.822929 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:05:31.822900    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" path="/var/lib/kubelet/pods/5ef3966e-bbc3-4844-95b2-3423fedbb393/volumes"
Jun 12 00:06:07.690678 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690633    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"]
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690950    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="feast-apply"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690961    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="feast-apply"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690976    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="registry"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690982    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="registry"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690990    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="feast-apply"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.690996    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="feast-apply"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691002    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691007    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691013    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691017    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691025    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691030    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691038    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="offline"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691043    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="offline"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691050    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="feast-init"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691055    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="feast-init"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691063    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691068    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691075    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="feast-init"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691079    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="feast-init"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691086    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="offline"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691091    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="offline"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691136    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="offline"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691142    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="registry"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691151    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="ui"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691156    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="online"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691162    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c3807a-427e-4b93-83f6-37f73879907a" containerName="online"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691167    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="offline"
Jun 12 00:06:07.691160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.691172    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef3966e-bbc3-4844-95b2-3423fedbb393" containerName="ui"
Jun 12 00:06:07.695766 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.695743    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.698418 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698394    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 12 00:06:07.698418 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698416    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 12 00:06:07.698621 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698419    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 12 00:06:07.698621 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698518    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-skshb\""
Jun 12 00:06:07.698621 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698400    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 12 00:06:07.698621 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698462    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 12 00:06:07.698817 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.698803    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 12 00:06:07.706215 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.706193    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"]
Jun 12 00:06:07.780952 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.780929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.781045 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.780979    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.781045 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.781001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88n29\" (UniqueName: \"kubernetes.io/projected/8c605063-7253-437a-b253-170faa779f28-kube-api-access-88n29\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.781116 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.781052    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.781116 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.781076    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.781185 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.781134    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c605063-7253-437a-b253-170faa779f28-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882033 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c605063-7253-437a-b253-170faa779f28-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882131 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882131 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882131 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88n29\" (UniqueName: \"kubernetes.io/projected/8c605063-7253-437a-b253-170faa779f28-kube-api-access-88n29\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882378 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882378 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882378 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:06:07.882226    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 12 00:06:07.882378 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:06:07.882298    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls podName:8c605063-7253-437a-b253-170faa779f28 nodeName:}" failed. No retries permitted until 2026-06-12 00:06:08.382278759 +0000 UTC m=+1647.007351985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls") pod "feast-simple-feast-setup-75c64c888b-hj88m" (UID: "8c605063-7253-437a-b253-170faa779f28") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 12 00:06:07.882579 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:06:07.882384    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 12 00:06:07.882579 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.882432    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c605063-7253-437a-b253-170faa779f28-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.882579 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:06:07.882456    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls podName:8c605063-7253-437a-b253-170faa779f28 nodeName:}" failed. No retries permitted until 2026-06-12 00:06:08.382428611 +0000 UTC m=+1647.007501826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls") pod "feast-simple-feast-setup-75c64c888b-hj88m" (UID: "8c605063-7253-437a-b253-170faa779f28") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 12 00:06:07.884492 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.884463    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.884492 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.884490    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:07.892529 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:07.892510    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88n29\" (UniqueName: \"kubernetes.io/projected/8c605063-7253-437a-b253-170faa779f28-kube-api-access-88n29\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:08.385037 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:08.385016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:08.385145 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:08.385052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:08.387179 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:08.387151    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:08.387289 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:08.387272    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-hj88m\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:08.605132 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:08.605078    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:08.756510 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:08.756485    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"]
Jun 12 00:06:08.759121 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:06:08.759099    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c605063_7253_437a_b253_170faa779f28.slice/crio-719f2419a60e3d3a0433cb983e0e6aedc1ec77e3d5a9369fd96fdb05e8e41b2f WatchSource:0}: Error finding container 719f2419a60e3d3a0433cb983e0e6aedc1ec77e3d5a9369fd96fdb05e8e41b2f: Status 404 returned error can't find the container with id 719f2419a60e3d3a0433cb983e0e6aedc1ec77e3d5a9369fd96fdb05e8e41b2f
Jun 12 00:06:09.388028 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:09.387971    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"}
Jun 12 00:06:09.388216 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:09.388043    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"719f2419a60e3d3a0433cb983e0e6aedc1ec77e3d5a9369fd96fdb05e8e41b2f"}
Jun 12 00:06:13.406212 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:13.406178    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c605063-7253-437a-b253-170faa779f28" containerID="2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262" exitCode=0
Jun 12 00:06:13.406624 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:13.406250    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"}
Jun 12 00:06:14.412932 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:14.412893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"}
Jun 12 00:06:19.435703 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:19.435668    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c605063-7253-437a-b253-170faa779f28" containerID="c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049" exitCode=0
Jun 12 00:06:19.436130 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:19.435735    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"}
Jun 12 00:06:20.446009 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.445962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"}
Jun 12 00:06:20.446534 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.446028    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"}
Jun 12 00:06:20.446534 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.446048    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"}
Jun 12 00:06:20.446534 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.446066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerStarted","Data":"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"}
Jun 12 00:06:20.472711 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.472636    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podStartSLOduration=13.472614426 podStartE2EDuration="13.472614426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:06:20.469428111 +0000 UTC m=+1659.094501344" watchObservedRunningTime="2026-06-12 00:06:20.472614426 +0000 UTC m=+1659.097687659"
Jun 12 00:06:20.605671 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.605532    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:20.605671 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.605600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:20.605671 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.605620    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:20.605671 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.605639    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:20.608004 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.607849    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Jun 12 00:06:20.608004 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.607875    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jun 12 00:06:20.608004 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.607887    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
Jun 12 00:06:20.608004 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:20.607945    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jun 12 00:06:23.606020 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:23.605974    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Jun 12 00:06:23.606658 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:23.605974    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
Jun 12 00:06:23.606864 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:23.605974    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jun 12 00:06:23.606864 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:23.605996    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jun 12 00:06:26.606624 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.606588    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607142 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.606719    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607142 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.606983    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607351 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.607312    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607453 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.607392    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607453 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.607416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607666 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.607645    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607746 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.607721    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.607782 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.607769    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:26.611565 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:26.611542    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:27.488294 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:27.488249    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:06:27.491512 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:06:27.491489    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:07:29.181460 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.181414    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"]
Jun 12 00:07:29.182063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.181802    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="registry" containerID="cri-o://ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132" gracePeriod=30
Jun 12 00:07:29.182063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.181870    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="offline" containerID="cri-o://6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d" gracePeriod=30
Jun 12 00:07:29.182063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.181862    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online" containerID="cri-o://1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57" gracePeriod=30
Jun 12 00:07:29.182063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.182009    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui" containerID="cri-o://3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327" gracePeriod=30
Jun 12 00:07:29.553625 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.553570    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"]
Jun 12 00:07:29.557968 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.557932    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.560546 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.560508    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-j9vg9\""
Jun 12 00:07:29.567774 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.567737    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"]
Jun 12 00:07:29.643648 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.643577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.643883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.643707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/35972b3d-54b4-4638-8285-3a8001718038-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.643883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.643766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.643883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.643781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.643883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.643842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.644050 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.643891    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frdfm\" (UniqueName: \"kubernetes.io/projected/35972b3d-54b4-4638-8285-3a8001718038-kube-api-access-frdfm\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.744830 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.744767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745091 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.744851    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/35972b3d-54b4-4638-8285-3a8001718038-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745091 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.744894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745091 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.744917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745091 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.744943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745091 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.744968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frdfm\" (UniqueName: \"kubernetes.io/projected/35972b3d-54b4-4638-8285-3a8001718038-kube-api-access-frdfm\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745458 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.745423    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/35972b3d-54b4-4638-8285-3a8001718038-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.745605 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:29.745453    2575 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 12 00:07:29.745605 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:29.745552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls podName:35972b3d-54b4-4638-8285-3a8001718038 nodeName:}" failed. No retries permitted until 2026-06-12 00:07:30.245526847 +0000 UTC m=+1728.870600073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls") pod "feast-simple-feast-setup-75c64c888b-ljgs5" (UID: "35972b3d-54b4-4638-8285-3a8001718038") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 12 00:07:29.747815 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.747784    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.747815 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.747801    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.748126 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.747801    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:29.756455 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:29.756306    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frdfm\" (UniqueName: \"kubernetes.io/projected/35972b3d-54b4-4638-8285-3a8001718038-kube-api-access-frdfm\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:30.249985 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.249936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:30.252382 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.252358    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-ljgs5\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:30.471800 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.471755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:30.615123 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.615092    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"]
Jun 12 00:07:30.617836 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:07:30.617802    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35972b3d_54b4_4638_8285_3a8001718038.slice/crio-193c7f5b210ee4736303388ac6b45f68d30cecad3201030d916ffb76d99ef9b9 WatchSource:0}: Error finding container 193c7f5b210ee4736303388ac6b45f68d30cecad3201030d916ffb76d99ef9b9: Status 404 returned error can't find the container with id 193c7f5b210ee4736303388ac6b45f68d30cecad3201030d916ffb76d99ef9b9
Jun 12 00:07:30.749203 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.749168    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c605063-7253-437a-b253-170faa779f28" containerID="3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327" exitCode=0
Jun 12 00:07:30.749203 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.749195    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c605063-7253-437a-b253-170faa779f28" containerID="1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57" exitCode=0
Jun 12 00:07:30.749555 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.749247    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"}
Jun 12 00:07:30.749555 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.749293    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"}
Jun 12 00:07:30.750963 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.750935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"7b7abd5ab964065b226e94822c778661b3de62b4a949e47683deb5b757a9c20e"}
Jun 12 00:07:30.751098 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:30.750976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"193c7f5b210ee4736303388ac6b45f68d30cecad3201030d916ffb76d99ef9b9"}
Jun 12 00:07:35.775309 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:35.775267    2575 generic.go:356] "Generic (PLEG): container finished" podID="35972b3d-54b4-4638-8285-3a8001718038" containerID="7b7abd5ab964065b226e94822c778661b3de62b4a949e47683deb5b757a9c20e" exitCode=0
Jun 12 00:07:35.775647 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:35.775354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"7b7abd5ab964065b226e94822c778661b3de62b4a949e47683deb5b757a9c20e"}
Jun 12 00:07:36.607533 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:36.607490    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jun 12 00:07:36.781537 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:36.781496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"c587ddf15ea628e8c9274b885edfd92f0781bdd5a9a56eb03a5fff8dbcf6a8f5"}
Jun 12 00:07:37.488526 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:37.488486    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jun 12 00:07:41.804377 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:41.804258    2575 generic.go:356] "Generic (PLEG): container finished" podID="35972b3d-54b4-4638-8285-3a8001718038" containerID="c587ddf15ea628e8c9274b885edfd92f0781bdd5a9a56eb03a5fff8dbcf6a8f5" exitCode=0
Jun 12 00:07:41.804377 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:41.804359    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"c587ddf15ea628e8c9274b885edfd92f0781bdd5a9a56eb03a5fff8dbcf6a8f5"}
Jun 12 00:07:42.814895 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:42.814852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"bdf30c0fff111316835e572d50e84a3c63b26d07f8b8745ddb79cb1c61d6846c"}
Jun 12 00:07:42.815425 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:42.814914    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"bbe08b648effa98a5c52e974d5653f34ef7b5d491f3f783087a8d6d4c7f5aa0f"}
Jun 12 00:07:42.815425 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:42.814935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"70a19834b26f400ee302685a3f741a5d53fff9dd8ccbcf0d1212b925a389952e"}
Jun 12 00:07:42.815425 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:42.814956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerStarted","Data":"48ea94f8905af7d603e282791748a235db67beff059dcf8b6a637440a946399d"}
Jun 12 00:07:42.839796 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:42.839726    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podStartSLOduration=13.839701264 podStartE2EDuration="13.839701264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:07:42.837553564 +0000 UTC m=+1741.462627070" watchObservedRunningTime="2026-06-12 00:07:42.839701264 +0000 UTC m=+1741.464774500"
Jun 12 00:07:45.473037 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.472972    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:45.473571 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.473069    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:45.473571 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.473089    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:45.473571 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.473107    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:45.475170 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.475125    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
Jun 12 00:07:45.475170 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.475138    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jun 12 00:07:45.475419 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.475176    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.37:8816: connect: connection refused"
Jun 12 00:07:45.475419 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:45.475347    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jun 12 00:07:46.608149 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:46.608092    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jun 12 00:07:47.488936 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:47.488885    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jun 12 00:07:48.472883 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.472849    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.473387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.473109    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.473387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.473252    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.473387 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.473297    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.473593 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.473575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.473653 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.473642    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.473784 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.473766    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.477594 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.477575    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.848478 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.848372    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.848478 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.848428    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.849198 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.849179    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:48.851584 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:48.851567    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:07:56.608457 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:56.608398    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jun 12 00:07:56.608895 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:56.608601    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:07:57.488901 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:57.488856    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jun 12 00:07:57.489133 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:57.489009    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:07:59.847362 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.847312    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:07:59.899050 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899015    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c605063-7253-437a-b253-170faa779f28" containerID="6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d" exitCode=137
Jun 12 00:07:59.899050 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899046    2575 generic.go:356] "Generic (PLEG): container finished" podID="8c605063-7253-437a-b253-170faa779f28" containerID="ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132" exitCode=137
Jun 12 00:07:59.899282 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899083    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"
Jun 12 00:07:59.899282 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899092    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"}
Jun 12 00:07:59.899282 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899143    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"}
Jun 12 00:07:59.899282 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899162    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m" event={"ID":"8c605063-7253-437a-b253-170faa779f28","Type":"ContainerDied","Data":"719f2419a60e3d3a0433cb983e0e6aedc1ec77e3d5a9369fd96fdb05e8e41b2f"}
Jun 12 00:07:59.899282 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.899182    2575 scope.go:117] "RemoveContainer" containerID="3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"
Jun 12 00:07:59.908825 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.908800    2575 scope.go:117] "RemoveContainer" containerID="6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"
Jun 12 00:07:59.917812 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.917777    2575 scope.go:117] "RemoveContainer" containerID="1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"
Jun 12 00:07:59.926875 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.926853    2575 scope.go:117] "RemoveContainer" containerID="ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"
Jun 12 00:07:59.935904 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.935879    2575 scope.go:117] "RemoveContainer" containerID="c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"
Jun 12 00:07:59.944742 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.944718    2575 scope.go:117] "RemoveContainer" containerID="2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"
Jun 12 00:07:59.954062 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.954034    2575 scope.go:117] "RemoveContainer" containerID="3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"
Jun 12 00:07:59.954428 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:59.954403    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327\": container with ID starting with 3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327 not found: ID does not exist" containerID="3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"
Jun 12 00:07:59.954507 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.954438    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"} err="failed to get container status \"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327\": rpc error: code = NotFound desc = could not find container \"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327\": container with ID starting with 3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327 not found: ID does not exist"
Jun 12 00:07:59.954507 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.954458    2575 scope.go:117] "RemoveContainer" containerID="6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"
Jun 12 00:07:59.954776 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:59.954759    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d\": container with ID starting with 6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d not found: ID does not exist" containerID="6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"
Jun 12 00:07:59.954831 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.954786    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"} err="failed to get container status \"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d\": rpc error: code = NotFound desc = could not find container \"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d\": container with ID starting with 6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d not found: ID does not exist"
Jun 12 00:07:59.954831 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.954808    2575 scope.go:117] "RemoveContainer" containerID="1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"
Jun 12 00:07:59.955090 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:59.955069    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57\": container with ID starting with 1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57 not found: ID does not exist" containerID="1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"
Jun 12 00:07:59.955225 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.955096    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"} err="failed to get container status \"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57\": rpc error: code = NotFound desc = could not find container \"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57\": container with ID starting with 1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57 not found: ID does not exist"
Jun 12 00:07:59.955225 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.955117    2575 scope.go:117] "RemoveContainer" containerID="ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"
Jun 12 00:07:59.955404 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:59.955386    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132\": container with ID starting with ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132 not found: ID does not exist" containerID="ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"
Jun 12 00:07:59.955468 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.955408    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"} err="failed to get container status \"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132\": rpc error: code = NotFound desc = could not find container \"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132\": container with ID starting with ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132 not found: ID does not exist"
Jun 12 00:07:59.955468 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.955428    2575 scope.go:117] "RemoveContainer" containerID="c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"
Jun 12 00:07:59.955738 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:59.955719    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049\": container with ID starting with c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049 not found: ID does not exist" containerID="c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"
Jun 12 00:07:59.955804 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.955744    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"} err="failed to get container status \"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049\": rpc error: code = NotFound desc = could not find container \"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049\": container with ID starting with c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049 not found: ID does not exist"
Jun 12 00:07:59.955804 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.955759    2575 scope.go:117] "RemoveContainer" containerID="2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"
Jun 12 00:07:59.956016 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:07:59.955995    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262\": container with ID starting with 2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262 not found: ID does not exist" containerID="2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"
Jun 12 00:07:59.956102 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956031    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"} err="failed to get container status \"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262\": rpc error: code = NotFound desc = could not find container \"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262\": container with ID starting with 2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262 not found: ID does not exist"
Jun 12 00:07:59.956102 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956053    2575 scope.go:117] "RemoveContainer" containerID="3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"
Jun 12 00:07:59.956357 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956319    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327"} err="failed to get container status \"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327\": rpc error: code = NotFound desc = could not find container \"3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327\": container with ID starting with 3492d6edd8f1acba96957b86df7e99fa54ec362d4a25175944b84054abb9d327 not found: ID does not exist"
Jun 12 00:07:59.956437 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956358    2575 scope.go:117] "RemoveContainer" containerID="6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"
Jun 12 00:07:59.956623 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956605    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d"} err="failed to get container status \"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d\": rpc error: code = NotFound desc = could not find container \"6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d\": container with ID starting with 6a8f101c96e0c19cb48c075d85551ecfed55fba115adf9f8712499005394b39d not found: ID does not exist"
Jun 12 00:07:59.956680 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956623    2575 scope.go:117] "RemoveContainer" containerID="1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"
Jun 12 00:07:59.956868 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956850    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57"} err="failed to get container status \"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57\": rpc error: code = NotFound desc = could not find container \"1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57\": container with ID starting with 1634487503fe7056ebaaf31eff0b2f91591607725bed590cf1629e761df38a57 not found: ID does not exist"
Jun 12 00:07:59.956942 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.956866    2575 scope.go:117] "RemoveContainer" containerID="ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"
Jun 12 00:07:59.957112 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.957092    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132"} err="failed to get container status \"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132\": rpc error: code = NotFound desc = could not find container \"ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132\": container with ID starting with ff8f8423f4b464b65bd47a521e8c1d4e6abaffa3c06f908de9b41945d4d39132 not found: ID does not exist"
Jun 12 00:07:59.957165 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.957112    2575 scope.go:117] "RemoveContainer" containerID="c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"
Jun 12 00:07:59.957316 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.957298    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049"} err="failed to get container status \"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049\": rpc error: code = NotFound desc = could not find container \"c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049\": container with ID starting with c0c3e855d9775d251ad02957017fada04e28e1ccd41ad19221e0fda8c0283049 not found: ID does not exist"
Jun 12 00:07:59.957382 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.957316    2575 scope.go:117] "RemoveContainer" containerID="2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"
Jun 12 00:07:59.957640 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:07:59.957609    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262"} err="failed to get container status \"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262\": rpc error: code = NotFound desc = could not find container \"2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262\": container with ID starting with 2860f4cd5c45b690632ecb66bb26885e82934d25226c4ef337c1c169eeb43262 not found: ID does not exist"
Jun 12 00:08:00.008981 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.008940    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls\") pod \"8c605063-7253-437a-b253-170faa779f28\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") "
Jun 12 00:08:00.009196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.009000    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-ui-tls\") pod \"8c605063-7253-437a-b253-170faa779f28\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") "
Jun 12 00:08:00.009196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.009103    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88n29\" (UniqueName: \"kubernetes.io/projected/8c605063-7253-437a-b253-170faa779f28-kube-api-access-88n29\") pod \"8c605063-7253-437a-b253-170faa779f28\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") "
Jun 12 00:08:00.009196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.009137    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c605063-7253-437a-b253-170faa779f28-feast-data\") pod \"8c605063-7253-437a-b253-170faa779f28\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") "
Jun 12 00:08:00.009196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.009168    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-online-tls\") pod \"8c605063-7253-437a-b253-170faa779f28\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") "
Jun 12 00:08:00.009196 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.009196    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls\") pod \"8c605063-7253-437a-b253-170faa779f28\" (UID: \"8c605063-7253-437a-b253-170faa779f28\") "
Jun 12 00:08:00.009771 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.009740    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c605063-7253-437a-b253-170faa779f28-feast-data" (OuterVolumeSpecName: "feast-data") pod "8c605063-7253-437a-b253-170faa779f28" (UID: "8c605063-7253-437a-b253-170faa779f28"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:08:00.011831 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.011799    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8c605063-7253-437a-b253-170faa779f28" (UID: "8c605063-7253-437a-b253-170faa779f28"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:08:00.012059 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.012021    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-online-tls" (OuterVolumeSpecName: "online-tls") pod "8c605063-7253-437a-b253-170faa779f28" (UID: "8c605063-7253-437a-b253-170faa779f28"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:08:00.012059 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.012054    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8c605063-7253-437a-b253-170faa779f28" (UID: "8c605063-7253-437a-b253-170faa779f28"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:08:00.012213 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.012054    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c605063-7253-437a-b253-170faa779f28-kube-api-access-88n29" (OuterVolumeSpecName: "kube-api-access-88n29") pod "8c605063-7253-437a-b253-170faa779f28" (UID: "8c605063-7253-437a-b253-170faa779f28"). InnerVolumeSpecName "kube-api-access-88n29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:08:00.012213 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.012081    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c605063-7253-437a-b253-170faa779f28" (UID: "8c605063-7253-437a-b253-170faa779f28"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:08:00.110735 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.110682    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88n29\" (UniqueName: \"kubernetes.io/projected/8c605063-7253-437a-b253-170faa779f28-kube-api-access-88n29\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:08:00.110735 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.110726    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8c605063-7253-437a-b253-170faa779f28-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:08:00.110735 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.110740    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:08:00.111009 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.110755    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:08:00.111009 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.110767    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:08:00.111009 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.110777    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8c605063-7253-437a-b253-170faa779f28-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:08:00.223795 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.223746    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"]
Jun 12 00:08:00.229843 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:00.229803    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-hj88m"]
Jun 12 00:08:01.828948 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:01.828906    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c605063-7253-437a-b253-170faa779f28" path="/var/lib/kubelet/pods/8c605063-7253-437a-b253-170faa779f28/volumes"
Jun 12 00:08:41.992441 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:41.992406    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 12 00:08:41.994244 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:41.994220    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 12 00:08:41.996644 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:41.996621    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 12 00:08:41.998549 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:41.998526    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 12 00:08:50.873834 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.873793    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"]
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874138    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874151    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874161    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="offline"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874167    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="offline"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874173    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874179    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874194    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="feast-apply"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874199    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="feast-apply"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874215    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="feast-init"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874220    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="feast-init"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874227    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="registry"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874232    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="registry"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874281    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="registry"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874290    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="ui"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874296    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="online"
Jun 12 00:08:50.874323 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.874302    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c605063-7253-437a-b253-170faa779f28" containerName="offline"
Jun 12 00:08:50.878821 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.878800    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:50.881701 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.881671    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 12 00:08:50.881872 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.881717    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 12 00:08:50.881872 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.881682    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 12 00:08:50.881872 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.881768    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 12 00:08:50.882066 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.881951    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 12 00:08:50.882154 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.882139    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 12 00:08:50.882830 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.882815    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-gx26d\""
Jun 12 00:08:50.887701 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:50.887677    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"]
Jun 12 00:08:51.028632 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.028589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.028632 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.028634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/57c31f64-0037-471c-8bcc-10918ffd93c5-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.028926 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.028657    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zd6v\" (UniqueName: \"kubernetes.io/projected/57c31f64-0037-471c-8bcc-10918ffd93c5-kube-api-access-8zd6v\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.028926 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.028720    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.028926 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.028783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.028926 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.028819    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/57c31f64-0037-471c-8bcc-10918ffd93c5-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.129706 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.129599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.129706 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.129648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/57c31f64-0037-471c-8bcc-10918ffd93c5-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.129706 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.129680    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zd6v\" (UniqueName: \"kubernetes.io/projected/57c31f64-0037-471c-8bcc-10918ffd93c5-kube-api-access-8zd6v\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.129706 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.129703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.130031 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.129721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.130031 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.129755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/57c31f64-0037-471c-8bcc-10918ffd93c5-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.130031 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:08:51.129821    2575 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 12 00:08:51.130031 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:08:51.129947    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls podName:57c31f64-0037-471c-8bcc-10918ffd93c5 nodeName:}" failed. No retries permitted until 2026-06-12 00:08:51.629921293 +0000 UTC m=+1810.254994505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-xcvzg" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 12 00:08:51.130276 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.130250    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/57c31f64-0037-471c-8bcc-10918ffd93c5-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.130561 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.130542    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/57c31f64-0037-471c-8bcc-10918ffd93c5-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.132232 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.132212    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.132413 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.132394    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.138974 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.138942    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zd6v\" (UniqueName: \"kubernetes.io/projected/57c31f64-0037-471c-8bcc-10918ffd93c5-kube-api-access-8zd6v\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.634569 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.634526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.637681 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.637654    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-xcvzg\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.789777 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.789728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:08:51.943716 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:51.943682    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"]
Jun 12 00:08:51.946113 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:08:51.946078    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c31f64_0037_471c_8bcc_10918ffd93c5.slice/crio-a3d13a3e1fa38ee23be6e1bce78ed8c36fa2265f9d9e476e69ed2c7df356525b WatchSource:0}: Error finding container a3d13a3e1fa38ee23be6e1bce78ed8c36fa2265f9d9e476e69ed2c7df356525b: Status 404 returned error can't find the container with id a3d13a3e1fa38ee23be6e1bce78ed8c36fa2265f9d9e476e69ed2c7df356525b
Jun 12 00:08:52.121308 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:52.121265    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerStarted","Data":"f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684"}
Jun 12 00:08:52.121308 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:52.121314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerStarted","Data":"a3d13a3e1fa38ee23be6e1bce78ed8c36fa2265f9d9e476e69ed2c7df356525b"}
Jun 12 00:08:57.142223 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:57.142189    2575 generic.go:356] "Generic (PLEG): container finished" podID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerID="f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684" exitCode=0
Jun 12 00:08:57.142631 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:57.142270    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerDied","Data":"f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684"}
Jun 12 00:08:58.148770 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:08:58.148733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerStarted","Data":"59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8"}
Jun 12 00:09:04.178466 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:04.178408    2575 generic.go:356] "Generic (PLEG): container finished" podID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerID="59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8" exitCode=0
Jun 12 00:09:04.179009 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:04.178479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerDied","Data":"59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8"}
Jun 12 00:09:05.187687 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:05.187646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerStarted","Data":"5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750"}
Jun 12 00:09:05.188137 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:05.187714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerStarted","Data":"511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2"}
Jun 12 00:09:05.188137 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:05.187736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerStarted","Data":"bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c"}
Jun 12 00:09:05.212667 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:05.212593    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podStartSLOduration=15.212565024 podStartE2EDuration="15.212565024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:09:05.209243219 +0000 UTC m=+1823.834316453" watchObservedRunningTime="2026-06-12 00:09:05.212565024 +0000 UTC m=+1823.837638257"
Jun 12 00:09:06.790756 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:06.790640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:06.790756 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:06.790704    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:06.790756 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:06.790721    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:06.792512 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:06.792459    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Jun 12 00:09:06.792512 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:06.792487    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.38:8816: connect: connection refused"
Jun 12 00:09:06.792719 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:06.792494    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Jun 12 00:09:09.790635 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:09.790578    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.38:8816: connect: connection refused"
Jun 12 00:09:09.791167 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:09.790643    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Jun 12 00:09:09.791167 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:09.790578    2575 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Jun 12 00:09:11.790398 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:11.790355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:11.790797 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:11.790416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:11.790797 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:11.790429    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:12.791185 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:12.791153    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:12.791626 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:12.791285    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:12.791984 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:12.791958    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:12.792149 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:12.792129    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:12.795580 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:12.795557    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:09:13.232776 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:09:13.232743    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:10:13.913425 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:13.913388    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"]
Jun 12 00:10:13.913961 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:13.913710    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online" containerID="cri-o://bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c" gracePeriod=30
Jun 12 00:10:13.913961 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:13.913801    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui" containerID="cri-o://5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750" gracePeriod=30
Jun 12 00:10:13.913961 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:13.913911    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="offline" containerID="cri-o://511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2" gracePeriod=30
Jun 12 00:10:14.070961 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:14.070928    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"]
Jun 12 00:10:14.071281 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:14.071251    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="registry" containerID="cri-o://48ea94f8905af7d603e282791748a235db67beff059dcf8b6a637440a946399d" gracePeriod=30
Jun 12 00:10:14.071512 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:14.071259    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="offline" containerID="cri-o://bbe08b648effa98a5c52e974d5653f34ef7b5d491f3f783087a8d6d4c7f5aa0f" gracePeriod=30
Jun 12 00:10:14.071623 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:14.071259    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui" containerID="cri-o://bdf30c0fff111316835e572d50e84a3c63b26d07f8b8745ddb79cb1c61d6846c" gracePeriod=30
Jun 12 00:10:14.071715 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:14.071292    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online" containerID="cri-o://70a19834b26f400ee302685a3f741a5d53fff9dd8ccbcf0d1212b925a389952e" gracePeriod=30
Jun 12 00:10:15.506601 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.506563    2575 generic.go:356] "Generic (PLEG): container finished" podID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerID="5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750" exitCode=0
Jun 12 00:10:15.506601 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.506595    2575 generic.go:356] "Generic (PLEG): container finished" podID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerID="bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c" exitCode=0
Jun 12 00:10:15.507087 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.506632    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerDied","Data":"5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750"}
Jun 12 00:10:15.507087 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.506675    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerDied","Data":"bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c"}
Jun 12 00:10:15.509413 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.509385    2575 generic.go:356] "Generic (PLEG): container finished" podID="35972b3d-54b4-4638-8285-3a8001718038" containerID="bdf30c0fff111316835e572d50e84a3c63b26d07f8b8745ddb79cb1c61d6846c" exitCode=0
Jun 12 00:10:15.509413 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.509411    2575 generic.go:356] "Generic (PLEG): container finished" podID="35972b3d-54b4-4638-8285-3a8001718038" containerID="70a19834b26f400ee302685a3f741a5d53fff9dd8ccbcf0d1212b925a389952e" exitCode=0
Jun 12 00:10:15.509567 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.509448    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"bdf30c0fff111316835e572d50e84a3c63b26d07f8b8745ddb79cb1c61d6846c"}
Jun 12 00:10:15.509567 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:15.509475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"70a19834b26f400ee302685a3f741a5d53fff9dd8ccbcf0d1212b925a389952e"}
Jun 12 00:10:18.848934 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:18.848882    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jun 12 00:10:18.849362 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:18.848888    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jun 12 00:10:22.792538 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:22.792491    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Jun 12 00:10:23.230347 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:23.230285    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Jun 12 00:10:28.849719 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:28.849657    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jun 12 00:10:28.850235 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:28.849674    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jun 12 00:10:32.792347 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:32.792296    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Jun 12 00:10:33.230445 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:33.230401    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Jun 12 00:10:38.849520 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:38.849461    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jun 12 00:10:38.850088 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:38.849474    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jun 12 00:10:38.850088 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:38.849643    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:10:38.850088 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:38.849734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:10:42.792383 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:42.792306    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Jun 12 00:10:42.792902 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:42.792476    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:10:43.230684 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:43.230637    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Jun 12 00:10:43.230864 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:43.230800    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:10:44.578134 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.578106    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:10:44.635365 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.635314    2575 generic.go:356] "Generic (PLEG): container finished" podID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerID="511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2" exitCode=137
Jun 12 00:10:44.635627 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.635366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerDied","Data":"511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2"}
Jun 12 00:10:44.635627 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.635410    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"
Jun 12 00:10:44.635627 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.635429    2575 scope.go:117] "RemoveContainer" containerID="5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750"
Jun 12 00:10:44.635627 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.635415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg" event={"ID":"57c31f64-0037-471c-8bcc-10918ffd93c5","Type":"ContainerDied","Data":"a3d13a3e1fa38ee23be6e1bce78ed8c36fa2265f9d9e476e69ed2c7df356525b"}
Jun 12 00:10:44.639117 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.639078    2575 generic.go:356] "Generic (PLEG): container finished" podID="35972b3d-54b4-4638-8285-3a8001718038" containerID="bbe08b648effa98a5c52e974d5653f34ef7b5d491f3f783087a8d6d4c7f5aa0f" exitCode=137
Jun 12 00:10:44.639117 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.639103    2575 generic.go:356] "Generic (PLEG): container finished" podID="35972b3d-54b4-4638-8285-3a8001718038" containerID="48ea94f8905af7d603e282791748a235db67beff059dcf8b6a637440a946399d" exitCode=137
Jun 12 00:10:44.639350 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.639121    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"bbe08b648effa98a5c52e974d5653f34ef7b5d491f3f783087a8d6d4c7f5aa0f"}
Jun 12 00:10:44.639350 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.639168    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"48ea94f8905af7d603e282791748a235db67beff059dcf8b6a637440a946399d"}
Jun 12 00:10:44.645441 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.645418    2575 scope.go:117] "RemoveContainer" containerID="511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2"
Jun 12 00:10:44.654929 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.654766    2575 scope.go:117] "RemoveContainer" containerID="bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c"
Jun 12 00:10:44.664342 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.664307    2575 scope.go:117] "RemoveContainer" containerID="59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8"
Jun 12 00:10:44.674022 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.673999    2575 scope.go:117] "RemoveContainer" containerID="f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684"
Jun 12 00:10:44.682125 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.682102    2575 scope.go:117] "RemoveContainer" containerID="5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750"
Jun 12 00:10:44.682430 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:10:44.682410    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750\": container with ID starting with 5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750 not found: ID does not exist" containerID="5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750"
Jun 12 00:10:44.682491 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.682439    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750"} err="failed to get container status \"5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750\": rpc error: code = NotFound desc = could not find container \"5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750\": container with ID starting with 5ea69b55259ebf0aa683ee01e5bfad6845b4605b7a6f2c12329b27ef77028750 not found: ID does not exist"
Jun 12 00:10:44.682491 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.682458    2575 scope.go:117] "RemoveContainer" containerID="511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2"
Jun 12 00:10:44.682726 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:10:44.682706    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2\": container with ID starting with 511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2 not found: ID does not exist" containerID="511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2"
Jun 12 00:10:44.682773 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.682734    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2"} err="failed to get container status \"511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2\": rpc error: code = NotFound desc = could not find container \"511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2\": container with ID starting with 511f77d0e511416b26d7ecb4a2027ab3114fa182151afcdcb31b7e23439042f2 not found: ID does not exist"
Jun 12 00:10:44.682773 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.682751    2575 scope.go:117] "RemoveContainer" containerID="bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c"
Jun 12 00:10:44.683006 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:10:44.682987    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c\": container with ID starting with bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c not found: ID does not exist" containerID="bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c"
Jun 12 00:10:44.683055 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.683012    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c"} err="failed to get container status \"bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c\": rpc error: code = NotFound desc = could not find container \"bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c\": container with ID starting with bfbe0e4abcafe0dceead5a4fe885e222a659ace8eabdd7a6890a0cea9063e63c not found: ID does not exist"
Jun 12 00:10:44.683055 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.683029    2575 scope.go:117] "RemoveContainer" containerID="59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8"
Jun 12 00:10:44.683323 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:10:44.683299    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8\": container with ID starting with 59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8 not found: ID does not exist" containerID="59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8"
Jun 12 00:10:44.683486 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.683424    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8"} err="failed to get container status \"59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8\": rpc error: code = NotFound desc = could not find container \"59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8\": container with ID starting with 59b45850bb41ed59313779cf5242f9e7cd0dc5cbe20767050d6a63166a083fe8 not found: ID does not exist"
Jun 12 00:10:44.683486 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.683455    2575 scope.go:117] "RemoveContainer" containerID="f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684"
Jun 12 00:10:44.683758 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:10:44.683732    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684\": container with ID starting with f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684 not found: ID does not exist" containerID="f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684"
Jun 12 00:10:44.683812 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.683765    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684"} err="failed to get container status \"f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684\": rpc error: code = NotFound desc = could not find container \"f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684\": container with ID starting with f01f13e91c750177fe2177dc1fe301b15ae52d641e8bff6145ddc3be8fadf684 not found: ID does not exist"
Jun 12 00:10:44.722790 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.722765    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-ui-tls\") pod \"57c31f64-0037-471c-8bcc-10918ffd93c5\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") "
Jun 12 00:10:44.722915 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.722843    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/57c31f64-0037-471c-8bcc-10918ffd93c5-feast-data\") pod \"57c31f64-0037-471c-8bcc-10918ffd93c5\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") "
Jun 12 00:10:44.722915 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.722878    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/57c31f64-0037-471c-8bcc-10918ffd93c5-registry-tls\") pod \"57c31f64-0037-471c-8bcc-10918ffd93c5\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") "
Jun 12 00:10:44.722915 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.722910    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zd6v\" (UniqueName: \"kubernetes.io/projected/57c31f64-0037-471c-8bcc-10918ffd93c5-kube-api-access-8zd6v\") pod \"57c31f64-0037-471c-8bcc-10918ffd93c5\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") "
Jun 12 00:10:44.723080 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.722944    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls\") pod \"57c31f64-0037-471c-8bcc-10918ffd93c5\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") "
Jun 12 00:10:44.723080 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.722966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-online-tls\") pod \"57c31f64-0037-471c-8bcc-10918ffd93c5\" (UID: \"57c31f64-0037-471c-8bcc-10918ffd93c5\") "
Jun 12 00:10:44.723300 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.723261    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57c31f64-0037-471c-8bcc-10918ffd93c5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "57c31f64-0037-471c-8bcc-10918ffd93c5" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 12 00:10:44.723624 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.723600    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:10:44.723750 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.723703    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c31f64-0037-471c-8bcc-10918ffd93c5-feast-data" (OuterVolumeSpecName: "feast-data") pod "57c31f64-0037-471c-8bcc-10918ffd93c5" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:10:44.725136 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.725112    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "57c31f64-0037-471c-8bcc-10918ffd93c5" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.725230 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.725163    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "57c31f64-0037-471c-8bcc-10918ffd93c5" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.725230 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.725180    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c31f64-0037-471c-8bcc-10918ffd93c5-kube-api-access-8zd6v" (OuterVolumeSpecName: "kube-api-access-8zd6v") pod "57c31f64-0037-471c-8bcc-10918ffd93c5" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5"). InnerVolumeSpecName "kube-api-access-8zd6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:10:44.725230 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.725207    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-online-tls" (OuterVolumeSpecName: "online-tls") pod "57c31f64-0037-471c-8bcc-10918ffd93c5" (UID: "57c31f64-0037-471c-8bcc-10918ffd93c5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.824346 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824309    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-offline-tls\") pod \"35972b3d-54b4-4638-8285-3a8001718038\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") "
Jun 12 00:10:44.824559 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824382    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/35972b3d-54b4-4638-8285-3a8001718038-feast-data\") pod \"35972b3d-54b4-4638-8285-3a8001718038\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") "
Jun 12 00:10:44.824559 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-ui-tls\") pod \"35972b3d-54b4-4638-8285-3a8001718038\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") "
Jun 12 00:10:44.824559 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824464    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frdfm\" (UniqueName: \"kubernetes.io/projected/35972b3d-54b4-4638-8285-3a8001718038-kube-api-access-frdfm\") pod \"35972b3d-54b4-4638-8285-3a8001718038\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") "
Jun 12 00:10:44.824559 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824500    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls\") pod \"35972b3d-54b4-4638-8285-3a8001718038\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") "
Jun 12 00:10:44.824559 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824532    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-online-tls\") pod \"35972b3d-54b4-4638-8285-3a8001718038\" (UID: \"35972b3d-54b4-4638-8285-3a8001718038\") "
Jun 12 00:10:44.824832 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824718    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.824832 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824734    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/57c31f64-0037-471c-8bcc-10918ffd93c5-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.824832 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824748    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/57c31f64-0037-471c-8bcc-10918ffd93c5-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.824832 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824762    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zd6v\" (UniqueName: \"kubernetes.io/projected/57c31f64-0037-471c-8bcc-10918ffd93c5-kube-api-access-8zd6v\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.824832 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824775    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.824832 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824788    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/57c31f64-0037-471c-8bcc-10918ffd93c5-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.825128 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.824953    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35972b3d-54b4-4638-8285-3a8001718038-feast-data" (OuterVolumeSpecName: "feast-data") pod "35972b3d-54b4-4638-8285-3a8001718038" (UID: "35972b3d-54b4-4638-8285-3a8001718038"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:10:44.826751 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.826721    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-online-tls" (OuterVolumeSpecName: "online-tls") pod "35972b3d-54b4-4638-8285-3a8001718038" (UID: "35972b3d-54b4-4638-8285-3a8001718038"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.826751 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.826737    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "35972b3d-54b4-4638-8285-3a8001718038" (UID: "35972b3d-54b4-4638-8285-3a8001718038"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.826895 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.826758    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "35972b3d-54b4-4638-8285-3a8001718038" (UID: "35972b3d-54b4-4638-8285-3a8001718038"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.827023 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.827008    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35972b3d-54b4-4638-8285-3a8001718038-kube-api-access-frdfm" (OuterVolumeSpecName: "kube-api-access-frdfm") pod "35972b3d-54b4-4638-8285-3a8001718038" (UID: "35972b3d-54b4-4638-8285-3a8001718038"). InnerVolumeSpecName "kube-api-access-frdfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:10:44.827065 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.827010    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "35972b3d-54b4-4638-8285-3a8001718038" (UID: "35972b3d-54b4-4638-8285-3a8001718038"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 12 00:10:44.926017 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.925903    2575 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/35972b3d-54b4-4638-8285-3a8001718038-feast-data\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.926017 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.925932    2575 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-ui-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.926017 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.925944    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frdfm\" (UniqueName: \"kubernetes.io/projected/35972b3d-54b4-4638-8285-3a8001718038-kube-api-access-frdfm\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.926017 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.925957    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-registry-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.926017 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.925972    2575 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-online-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.926017 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.925983    2575 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/35972b3d-54b4-4638-8285-3a8001718038-offline-tls\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:10:44.959138 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.959100    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"]
Jun 12 00:10:44.964925 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:44.964895    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-xcvzg"]
Jun 12 00:10:45.645917 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.645878    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"
Jun 12 00:10:45.645917 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.645888    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5" event={"ID":"35972b3d-54b4-4638-8285-3a8001718038","Type":"ContainerDied","Data":"193c7f5b210ee4736303388ac6b45f68d30cecad3201030d916ffb76d99ef9b9"}
Jun 12 00:10:45.646478 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.645953    2575 scope.go:117] "RemoveContainer" containerID="bdf30c0fff111316835e572d50e84a3c63b26d07f8b8745ddb79cb1c61d6846c"
Jun 12 00:10:45.655682 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.655660    2575 scope.go:117] "RemoveContainer" containerID="bbe08b648effa98a5c52e974d5653f34ef7b5d491f3f783087a8d6d4c7f5aa0f"
Jun 12 00:10:45.664197 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.664177    2575 scope.go:117] "RemoveContainer" containerID="70a19834b26f400ee302685a3f741a5d53fff9dd8ccbcf0d1212b925a389952e"
Jun 12 00:10:45.669719 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.669691    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"]
Jun 12 00:10:45.672692 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.672676    2575 scope.go:117] "RemoveContainer" containerID="48ea94f8905af7d603e282791748a235db67beff059dcf8b6a637440a946399d"
Jun 12 00:10:45.674921 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.674900    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-ljgs5"]
Jun 12 00:10:45.680948 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.680930    2575 scope.go:117] "RemoveContainer" containerID="c587ddf15ea628e8c9274b885edfd92f0781bdd5a9a56eb03a5fff8dbcf6a8f5"
Jun 12 00:10:45.688484 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.688465    2575 scope.go:117] "RemoveContainer" containerID="7b7abd5ab964065b226e94822c778661b3de62b4a949e47683deb5b757a9c20e"
Jun 12 00:10:45.825821 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.825782    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35972b3d-54b4-4638-8285-3a8001718038" path="/var/lib/kubelet/pods/35972b3d-54b4-4638-8285-3a8001718038/volumes"
Jun 12 00:10:45.826543 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:10:45.826522    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" path="/var/lib/kubelet/pods/57c31f64-0037-471c-8bcc-10918ffd93c5/volumes"
Jun 12 00:11:03.090451 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090403    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xz7tj/must-gather-4pd7w"]
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090764    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090775    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090784    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="feast-apply"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090790    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="feast-apply"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090798    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="feast-apply"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090805    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="feast-apply"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090810    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090817    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090826    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="registry"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090831    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="registry"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090840    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="feast-init"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090845    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="feast-init"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090855    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090861    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090867    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="offline"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090872    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="offline"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090877    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="offline"
Jun 12 00:11:03.090878 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090882    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="offline"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090890    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090895    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090903    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="feast-init"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090908    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="feast-init"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090966    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="ui"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090974    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="online"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090981    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="ui"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090987    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="offline"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090992    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="online"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.090997    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="35972b3d-54b4-4638-8285-3a8001718038" containerName="registry"
Jun 12 00:11:03.091485 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.091003    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c31f64-0037-471c-8bcc-10918ffd93c5" containerName="offline"
Jun 12 00:11:03.094133 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.094106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.096720 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.096689    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xz7tj\"/\"openshift-service-ca.crt\""
Jun 12 00:11:03.096863 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.096693    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xz7tj\"/\"kube-root-ca.crt\""
Jun 12 00:11:03.097639 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.097618    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xz7tj\"/\"default-dockercfg-zj4fz\""
Jun 12 00:11:03.108593 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.105296    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xz7tj/must-gather-4pd7w"]
Jun 12 00:11:03.159085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.159020    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6fb98d2-1c16-44c3-9838-01bf00cd2085-must-gather-output\") pod \"must-gather-4pd7w\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") " pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.159085 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.159086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgpkc\" (UniqueName: \"kubernetes.io/projected/f6fb98d2-1c16-44c3-9838-01bf00cd2085-kube-api-access-jgpkc\") pod \"must-gather-4pd7w\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") " pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.259747 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.259690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6fb98d2-1c16-44c3-9838-01bf00cd2085-must-gather-output\") pod \"must-gather-4pd7w\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") " pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.259747 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.259748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgpkc\" (UniqueName: \"kubernetes.io/projected/f6fb98d2-1c16-44c3-9838-01bf00cd2085-kube-api-access-jgpkc\") pod \"must-gather-4pd7w\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") " pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.260081 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.260050    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6fb98d2-1c16-44c3-9838-01bf00cd2085-must-gather-output\") pod \"must-gather-4pd7w\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") " pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.267559 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.267527    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgpkc\" (UniqueName: \"kubernetes.io/projected/f6fb98d2-1c16-44c3-9838-01bf00cd2085-kube-api-access-jgpkc\") pod \"must-gather-4pd7w\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") " pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.411369 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.411234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:03.565955 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.565902    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xz7tj/must-gather-4pd7w"]
Jun 12 00:11:03.569550 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:11:03.569517    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6fb98d2_1c16_44c3_9838_01bf00cd2085.slice/crio-f8628d119409c9a15a272e9edb4840ccfaafd05f70642d7abb732c8d1bbccfd7 WatchSource:0}: Error finding container f8628d119409c9a15a272e9edb4840ccfaafd05f70642d7abb732c8d1bbccfd7: Status 404 returned error can't find the container with id f8628d119409c9a15a272e9edb4840ccfaafd05f70642d7abb732c8d1bbccfd7
Jun 12 00:11:03.571896 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.571876    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 12 00:11:03.726135 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:03.726093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz7tj/must-gather-4pd7w" event={"ID":"f6fb98d2-1c16-44c3-9838-01bf00cd2085","Type":"ContainerStarted","Data":"f8628d119409c9a15a272e9edb4840ccfaafd05f70642d7abb732c8d1bbccfd7"}
Jun 12 00:11:09.760793 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:09.760759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz7tj/must-gather-4pd7w" event={"ID":"f6fb98d2-1c16-44c3-9838-01bf00cd2085","Type":"ContainerStarted","Data":"dcd00a2a0e8c2cd08b854649ed8c821723e768779946fe3fcd5ccb341ac82a5f"}
Jun 12 00:11:10.768138 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:10.768098    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz7tj/must-gather-4pd7w" event={"ID":"f6fb98d2-1c16-44c3-9838-01bf00cd2085","Type":"ContainerStarted","Data":"fb4df78e353471f74e0af459a7e97aa840179e4e1aaf9c4caf6e90dcad87cae0"}
Jun 12 00:11:10.783762 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:10.783708    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xz7tj/must-gather-4pd7w" podStartSLOduration=1.754661907 podStartE2EDuration="7.78369016s" totalImagesPullingTime="6.029028253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 00:11:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:11:10.782605829 +0000 UTC m=+1949.407679151" watchObservedRunningTime="2026-06-12 00:11:10.78369016 +0000 UTC m=+1949.408763393"
Jun 12 00:11:19.805560 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:19.805521    2575 generic.go:356] "Generic (PLEG): container finished" podID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerID="dcd00a2a0e8c2cd08b854649ed8c821723e768779946fe3fcd5ccb341ac82a5f" exitCode=0
Jun 12 00:11:19.806080 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:19.805595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz7tj/must-gather-4pd7w" event={"ID":"f6fb98d2-1c16-44c3-9838-01bf00cd2085","Type":"ContainerDied","Data":"dcd00a2a0e8c2cd08b854649ed8c821723e768779946fe3fcd5ccb341ac82a5f"}
Jun 12 00:11:19.806080 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:19.805941    2575 scope.go:117] "RemoveContainer" containerID="dcd00a2a0e8c2cd08b854649ed8c821723e768779946fe3fcd5ccb341ac82a5f"
Jun 12 00:11:20.318092 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:20.318058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xz7tj_must-gather-4pd7w_f6fb98d2-1c16-44c3-9838-01bf00cd2085/gather/0.log"
Jun 12 00:11:23.399003 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:23.398963    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jxqhp_4d68dfd8-9ad7-4f45-a4f3-4ffd4099a55e/global-pull-secret-syncer/0.log"
Jun 12 00:11:23.639748 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:23.639705    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zmksl_b2f3392d-6d18-4719-bedb-0e416e2b52bf/konnectivity-agent/0.log"
Jun 12 00:11:23.662651 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:23.662543    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-3.ec2.internal_3c2aaf6ed69256f21f9f06c54d5921e8/haproxy/0.log"
Jun 12 00:11:25.665934 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.665887    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xz7tj/must-gather-4pd7w"]
Jun 12 00:11:25.666474 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.666141    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-xz7tj/must-gather-4pd7w" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="copy" containerID="cri-o://fb4df78e353471f74e0af459a7e97aa840179e4e1aaf9c4caf6e90dcad87cae0" gracePeriod=2
Jun 12 00:11:25.668484 ip-10-0-134-3 kubenswrapper[2575]: E0612 00:11:25.668438    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-4pd7w\" is forbidden: User \"system:node:ip-10-0-134-3.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xz7tj\": no relationship found between node 'ip-10-0-134-3.ec2.internal' and this object" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:25.670725 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.670040    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xz7tj/must-gather-4pd7w"]
Jun 12 00:11:25.833062 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.833031    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xz7tj_must-gather-4pd7w_f6fb98d2-1c16-44c3-9838-01bf00cd2085/copy/0.log"
Jun 12 00:11:25.833463 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.833438    2575 generic.go:356] "Generic (PLEG): container finished" podID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerID="fb4df78e353471f74e0af459a7e97aa840179e4e1aaf9c4caf6e90dcad87cae0" exitCode=143
Jun 12 00:11:25.906934 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.906910    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xz7tj_must-gather-4pd7w_f6fb98d2-1c16-44c3-9838-01bf00cd2085/copy/0.log"
Jun 12 00:11:25.908909 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.908890    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:25.939592 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.939485    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgpkc\" (UniqueName: \"kubernetes.io/projected/f6fb98d2-1c16-44c3-9838-01bf00cd2085-kube-api-access-jgpkc\") pod \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") "
Jun 12 00:11:25.939592 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.939566    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6fb98d2-1c16-44c3-9838-01bf00cd2085-must-gather-output\") pod \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\" (UID: \"f6fb98d2-1c16-44c3-9838-01bf00cd2085\") "
Jun 12 00:11:25.939904 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.939868    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fb98d2-1c16-44c3-9838-01bf00cd2085-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "f6fb98d2-1c16-44c3-9838-01bf00cd2085" (UID: "f6fb98d2-1c16-44c3-9838-01bf00cd2085"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 12 00:11:25.941852 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:25.941820    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fb98d2-1c16-44c3-9838-01bf00cd2085-kube-api-access-jgpkc" (OuterVolumeSpecName: "kube-api-access-jgpkc") pod "f6fb98d2-1c16-44c3-9838-01bf00cd2085" (UID: "f6fb98d2-1c16-44c3-9838-01bf00cd2085"). InnerVolumeSpecName "kube-api-access-jgpkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 12 00:11:26.040792 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:26.040752    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgpkc\" (UniqueName: \"kubernetes.io/projected/f6fb98d2-1c16-44c3-9838-01bf00cd2085-kube-api-access-jgpkc\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:11:26.040792 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:26.040785    2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f6fb98d2-1c16-44c3-9838-01bf00cd2085-must-gather-output\") on node \"ip-10-0-134-3.ec2.internal\" DevicePath \"\""
Jun 12 00:11:26.839063 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:26.839035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xz7tj_must-gather-4pd7w_f6fb98d2-1c16-44c3-9838-01bf00cd2085/copy/0.log"
Jun 12 00:11:26.839538 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:26.839457    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz7tj/must-gather-4pd7w"
Jun 12 00:11:26.839538 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:26.839500    2575 scope.go:117] "RemoveContainer" containerID="fb4df78e353471f74e0af459a7e97aa840179e4e1aaf9c4caf6e90dcad87cae0"
Jun 12 00:11:26.848129 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:26.848108    2575 scope.go:117] "RemoveContainer" containerID="dcd00a2a0e8c2cd08b854649ed8c821723e768779946fe3fcd5ccb341ac82a5f"
Jun 12 00:11:27.826273 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:27.826237    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" path="/var/lib/kubelet/pods/f6fb98d2-1c16-44c3-9838-01bf00cd2085/volumes"
Jun 12 00:11:27.836990 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:27.836959    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-cgm6g_dd833a57-64b0-4eb9-922c-a51f1bd61190/cluster-monitoring-operator/0.log"
Jun 12 00:11:27.874736 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:27.874698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-zp4nm_4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7/kube-state-metrics/0.log"
Jun 12 00:11:27.898734 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:27.898710    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-zp4nm_4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7/kube-rbac-proxy-main/0.log"
Jun 12 00:11:27.923789 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:27.923764    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-zp4nm_4fc4bac2-b8fd-48d1-8b4c-c94007a26ff7/kube-rbac-proxy-self/0.log"
Jun 12 00:11:27.982608 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:27.982582    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-nn6nt_8ecac60e-e169-4d3a-b932-e43de82cc570/monitoring-plugin/0.log"
Jun 12 00:11:28.110021 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.109931    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-swrp6_c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0/node-exporter/0.log"
Jun 12 00:11:28.135038 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.135003    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-swrp6_c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0/kube-rbac-proxy/0.log"
Jun 12 00:11:28.157160 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.157131    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-swrp6_c9d789ef-3f56-4d6a-9abf-25b8ad1e1bf0/init-textfile/0.log"
Jun 12 00:11:28.269073 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.269032    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-zz6tw_0ee6cff7-6575-4631-af85-7b3572534484/kube-rbac-proxy-main/0.log"
Jun 12 00:11:28.290872 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.290821    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-zz6tw_0ee6cff7-6575-4631-af85-7b3572534484/kube-rbac-proxy-self/0.log"
Jun 12 00:11:28.311917 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.311877    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-zz6tw_0ee6cff7-6575-4631-af85-7b3572534484/openshift-state-metrics/0.log"
Jun 12 00:11:28.612307 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.612268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-54lf8_5ac0c1e4-17fa-4108-8e78-eb6817735945/prometheus-operator-admission-webhook/0.log"
Jun 12 00:11:28.760568 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.760533    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69cfcb9b8b-c4msz_e3a7b763-4fb8-404a-9141-00ba3f164052/thanos-query/0.log"
Jun 12 00:11:28.786871 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.786840    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69cfcb9b8b-c4msz_e3a7b763-4fb8-404a-9141-00ba3f164052/kube-rbac-proxy-web/0.log"
Jun 12 00:11:28.810751 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.810718    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69cfcb9b8b-c4msz_e3a7b763-4fb8-404a-9141-00ba3f164052/kube-rbac-proxy/0.log"
Jun 12 00:11:28.834731 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.834699    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69cfcb9b8b-c4msz_e3a7b763-4fb8-404a-9141-00ba3f164052/prom-label-proxy/0.log"
Jun 12 00:11:28.858411 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.858314    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69cfcb9b8b-c4msz_e3a7b763-4fb8-404a-9141-00ba3f164052/kube-rbac-proxy-rules/0.log"
Jun 12 00:11:28.881289 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:28.881260    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69cfcb9b8b-c4msz_e3a7b763-4fb8-404a-9141-00ba3f164052/kube-rbac-proxy-metrics/0.log"
Jun 12 00:11:30.396353 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.396315    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/1.log"
Jun 12 00:11:30.406431 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.406399    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-bfc5w_cb48ef7e-7d0c-4393-84c9-5a3c507a4d3b/console-operator/2.log"
Jun 12 00:11:30.964416 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964377    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"]
Jun 12 00:11:30.964713 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964701    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="gather"
Jun 12 00:11:30.964776 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964715    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="gather"
Jun 12 00:11:30.964776 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964729    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="copy"
Jun 12 00:11:30.964776 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964734    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="copy"
Jun 12 00:11:30.964885 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964794    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="copy"
Jun 12 00:11:30.964885 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.964803    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fb98d2-1c16-44c3-9838-01bf00cd2085" containerName="gather"
Jun 12 00:11:30.968699 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.968677    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:30.974224 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.974200    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvjkn\"/\"kube-root-ca.crt\""
Jun 12 00:11:30.975923 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.975895    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvjkn\"/\"openshift-service-ca.crt\""
Jun 12 00:11:30.976022 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.975974    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tvjkn\"/\"default-dockercfg-cfrzh\""
Jun 12 00:11:30.977972 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:30.977941    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"]
Jun 12 00:11:31.081288 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.081245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-podres\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.081288 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.081284    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsfpr\" (UniqueName: \"kubernetes.io/projected/55cea8f7-12eb-4661-abaa-5d67df50730e-kube-api-access-bsfpr\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.081575 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.081327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-proc\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.081575 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.081387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-lib-modules\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.081575 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.081418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-sys\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182183 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-podres\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182183 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182186    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsfpr\" (UniqueName: \"kubernetes.io/projected/55cea8f7-12eb-4661-abaa-5d67df50730e-kube-api-access-bsfpr\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-proc\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182253    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-lib-modules\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182286    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-sys\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182327    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-podres\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182387    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-proc\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182419    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-lib-modules\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.182456 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.182438    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55cea8f7-12eb-4661-abaa-5d67df50730e-sys\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.190217 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.190193    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsfpr\" (UniqueName: \"kubernetes.io/projected/55cea8f7-12eb-4661-abaa-5d67df50730e-kube-api-access-bsfpr\") pod \"perf-node-gather-daemonset-9h97q\" (UID: \"55cea8f7-12eb-4661-abaa-5d67df50730e\") " pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.280326 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.280215    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.415305 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.415263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"]
Jun 12 00:11:31.418667 ip-10-0-134-3 kubenswrapper[2575]: W0612 00:11:31.418620    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55cea8f7_12eb_4661_abaa_5d67df50730e.slice/crio-b26240fd5a16b91ed95b284e28ff20751dbee27607c547de742ba49d1433a9aa WatchSource:0}: Error finding container b26240fd5a16b91ed95b284e28ff20751dbee27607c547de742ba49d1433a9aa: Status 404 returned error can't find the container with id b26240fd5a16b91ed95b284e28ff20751dbee27607c547de742ba49d1433a9aa
Jun 12 00:11:31.473537 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.473511    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-t9rsm_b2e24e83-c8ce-44de-94be-66a420d5611b/volume-data-source-validator/0.log"
Jun 12 00:11:31.861447 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.861352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q" event={"ID":"55cea8f7-12eb-4661-abaa-5d67df50730e","Type":"ContainerStarted","Data":"64974ef8378fbf1c6cb0567db1ab44cd97aa6995a5f687e2d290550f5545c6d9"}
Jun 12 00:11:31.861447 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.861412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q" event={"ID":"55cea8f7-12eb-4661-abaa-5d67df50730e","Type":"ContainerStarted","Data":"b26240fd5a16b91ed95b284e28ff20751dbee27607c547de742ba49d1433a9aa"}
Jun 12 00:11:31.861642 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.861502    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:31.877098 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:31.877035    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q" podStartSLOduration=1.877019508 podStartE2EDuration="1.877019508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 00:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 00:11:31.875644695 +0000 UTC m=+1970.500717929" watchObservedRunningTime="2026-06-12 00:11:31.877019508 +0000 UTC m=+1970.502092741"
Jun 12 00:11:32.353241 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:32.353206    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wnxwr_68c14c4c-a784-488b-a05b-f433997ff9aa/dns/0.log"
Jun 12 00:11:32.375949 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:32.375915    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wnxwr_68c14c4c-a784-488b-a05b-f433997ff9aa/kube-rbac-proxy/0.log"
Jun 12 00:11:32.464307 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:32.464275    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kkkdw_54d9ef40-4514-470d-9759-ea08e6fe0130/dns-node-resolver/0.log"
Jun 12 00:11:32.908795 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:32.908761    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-drf29_8c2df9da-e961-487f-8d73-ed899abe70a8/node-ca/0.log"
Jun 12 00:11:33.669762 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:33.669727    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69d57fc9d6-56v69_1123599e-b4ef-4fa1-a1d9-0779307aa0c0/router/0.log"
Jun 12 00:11:34.041571 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:34.041519    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpw5k_f8bde608-1875-4b39-8290-36a12dd3606a/serve-healthcheck-canary/0.log"
Jun 12 00:11:34.482188 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:34.482148    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djwv4_0f5db294-aa74-4d26-8753-0c17a23aaba2/kube-rbac-proxy/0.log"
Jun 12 00:11:34.503937 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:34.503895    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djwv4_0f5db294-aa74-4d26-8753-0c17a23aaba2/exporter/0.log"
Jun 12 00:11:34.526340 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:34.526309    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djwv4_0f5db294-aa74-4d26-8753-0c17a23aaba2/extractor/0.log"
Jun 12 00:11:37.877179 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:37.877144    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tvjkn/perf-node-gather-daemonset-9h97q"
Jun 12 00:11:38.861407 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:38.861365    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7wtv2_838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a/kube-storage-version-migrator-operator/1.log"
Jun 12 00:11:38.863050 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:38.863006    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-7wtv2_838a3ba8-6d5e-4ab1-8d74-d198eb2ab77a/kube-storage-version-migrator-operator/0.log"
Jun 12 00:11:40.041402 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.041368    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/kube-multus-additional-cni-plugins/0.log"
Jun 12 00:11:40.074903 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.074831    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/egress-router-binary-copy/0.log"
Jun 12 00:11:40.101936 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.101904    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/cni-plugins/0.log"
Jun 12 00:11:40.136069 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.136038    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/bond-cni-plugin/0.log"
Jun 12 00:11:40.167659 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.167635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/routeoverride-cni/0.log"
Jun 12 00:11:40.200846 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.200818    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/whereabouts-cni-bincopy/0.log"
Jun 12 00:11:40.235731 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.235698    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92lbx_4f0c8f0e-52ba-442b-8872-20b6387842f9/whereabouts-cni/0.log"
Jun 12 00:11:40.477677 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.477638    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jrq9v_6f057821-6f06-40e3-8c1c-da609c5aff0a/kube-multus/0.log"
Jun 12 00:11:40.506516 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.506486    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5sgch_615ce39c-819f-46bf-9688-acb9626db9a7/network-metrics-daemon/0.log"
Jun 12 00:11:40.530819 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:40.530781    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5sgch_615ce39c-819f-46bf-9688-acb9626db9a7/kube-rbac-proxy/0.log"
Jun 12 00:11:41.338148 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.338078    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-controller/0.log"
Jun 12 00:11:41.365555 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.365527    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/0.log"
Jun 12 00:11:41.365555 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.365523    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovn-acl-logging/1.log"
Jun 12 00:11:41.394077 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.394044    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/kube-rbac-proxy-node/0.log"
Jun 12 00:11:41.422754 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.422721    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/kube-rbac-proxy-ovn-metrics/0.log"
Jun 12 00:11:41.445280 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.445245    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/northd/0.log"
Jun 12 00:11:41.476222 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.476192    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/nbdb/0.log"
Jun 12 00:11:41.500354 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.500311    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/sbdb/0.log"
Jun 12 00:11:41.567432 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:41.567394    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtk6w_4e916115-6719-44ab-8afb-ccc4622a508a/ovnkube-controller/0.log"
Jun 12 00:11:42.898396 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:42.898365    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6947749cfc-2gj8s_5be13a02-5e1a-4d09-bbfd-7e6edae0ab16/check-endpoints/0.log"
Jun 12 00:11:42.947297 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:42.947265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zdjh9_c3764482-65ef-4753-aaab-f03fb5a05113/network-check-target-container/0.log"
Jun 12 00:11:43.806202 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:43.806172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hhbng_5ab67604-e71e-4ae6-a8d1-3cb867035ecf/iptables-alerter/0.log"
Jun 12 00:11:44.497803 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:44.497757    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r8jch_140bde72-8309-4551-8328-e82f998d729f/tuned/0.log"
Jun 12 00:11:47.333455 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:47.333406    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-7ccbfd59dc-gdlll_2c006d1a-f1fb-40e5-b91a-b5aca8d0118c/service-ca-operator/1.log"
Jun 12 00:11:47.335155 ip-10-0-134-3 kubenswrapper[2575]: I0612 00:11:47.335122    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-7ccbfd59dc-gdlll_2c006d1a-f1fb-40e5-b91a-b5aca8d0118c/service-ca-operator/0.log"