Sep 07 17:08:34.145010 ip-10-0-138-5 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 17:08:34.571492 ip-10-0-138-5 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 17:08:34.571492 ip-10-0-138-5 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 17:08:34.571492 ip-10-0-138-5 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 17:08:34.571492 ip-10-0-138-5 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 17:08:34.571492 ip-10-0-138-5 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 17:08:34.572402 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.572322    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 17:08:34.575508 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575492    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 17:08:34.575508 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575508    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575512    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575516    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575519    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575522    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575525    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575528    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575531    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575534    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575536    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575539    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575545    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575548    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575551    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575553    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575556    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575559    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575562    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575564    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575567    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 17:08:34.575578 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575570    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575573    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575576    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575580    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575584    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575587    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575590    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575594    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575597    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575600    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575602    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575606    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575608    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575611    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575614    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575617    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575619    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575622    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575625    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 17:08:34.576073 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575628    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575630    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575634    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575636    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575639    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575642    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575645    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575648    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575650    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575653    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575655    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575658    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575661    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575663    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575666    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575669    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575673    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575675    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575678    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575681    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 17:08:34.576626 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575684    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575686    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575689    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575692    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575694    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575697    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575700    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575702    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575705    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575710    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575714    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575716    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575719    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575721    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575724    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575727    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575741    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575744    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575747    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575750    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 17:08:34.577154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575752    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575755    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575757    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575760    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575762    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575766    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575770    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575775    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575778    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575780    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575783    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575786    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575788    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575791    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575793    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575796    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575798    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575801    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.575803    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 17:08:34.577669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576470    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576476    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576480    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576483    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576485    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576488    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576491    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576494    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576496    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576499    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576501    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576504    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576507    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576510    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576513    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576516    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576518    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576520    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576523    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576526    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 17:08:34.578150 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576529    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576532    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576534    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576537    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576540    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576543    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576545    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576548    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576550    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576553    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576556    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576558    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576561    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576563    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576566    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576568    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576571    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576573    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576576    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576579    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 17:08:34.578649 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576581    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576584    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576586    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576589    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576591    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576595    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576597    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576600    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576602    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576605    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576607    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576610    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576613    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576615    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576618    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576621    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576623    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576626    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576628    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576631    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 17:08:34.579183 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576636    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576638    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576641    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576644    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576648    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576651    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576654    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576657    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576660    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576662    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576665    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576668    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576670    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576673    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576676    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576678    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576681    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576683    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576686    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 17:08:34.579669 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576689    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576693    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576698    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576701    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576705    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576708    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576710    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576713    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576716    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576719    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576722    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576725    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576727    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576745    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576748    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576750    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576753    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576755    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576760    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 17:08:34.580154 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.576764    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577148    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577154    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577158    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577162    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577165    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577168    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577171    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577173    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577176    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577180    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577183    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577187    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577190    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577193    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577196    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577198    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577201    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577204    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 17:08:34.580610 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577207    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577209    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577212    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577215    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577217    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577220    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577222    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577225    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577228    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577230    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577233    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577236    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577240    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577243    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577245    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577248    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577251    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577254    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577257    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577259    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 17:08:34.581093 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577262    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577265    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577267    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577270    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577272    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577275    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577278    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577281    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577283    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577286    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577288    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577291    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577293    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577296    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577298    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577301    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577303    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577305    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577308    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577310    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 17:08:34.581579 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577313    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577315    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577318    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577320    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577325    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577327    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577330    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577332    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577335    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577338    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577340    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577342    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577345    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577348    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577350    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577353    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577355    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577358    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577361    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577364    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 17:08:34.582087 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577366    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577369    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577371    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577374    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577376    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577379    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577381    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577384    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577386    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577390    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577394    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577397    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577399    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577402    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577404    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577406    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577410    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577413    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577415    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577419    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 17:08:34.582613 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.577421    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577488    2566 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577519    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577527    2566 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577532    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577535    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577539    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577543    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577547    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577550    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577553    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577557    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577561    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577564    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577567    2566 flags.go:64] FLAG: --cgroup-root=""
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577570    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577572    2566 flags.go:64] FLAG: --client-ca-file=""
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577575    2566 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577578    2566 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577582    2566 flags.go:64] FLAG: --cluster-domain=""
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577585    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577588    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577591    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577594    2566 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 17:08:34.583134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577597    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577600    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577603    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577606    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577611    2566 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577614    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577618    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577623    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577626    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577630    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577632    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577635    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577638    2566 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577641    2566 flags.go:64] FLAG: --enable-server="true"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577644    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577648    2566 flags.go:64] FLAG: --event-burst="100"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577652    2566 flags.go:64] FLAG: --event-qps="50"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577654    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577657    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577660    2566 flags.go:64] FLAG: --eviction-hard=""
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577664    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577667    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577670    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577673    2566 flags.go:64] FLAG: --eviction-soft=""
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577676    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 17:08:34.583739 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577679    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577682    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577685    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577688    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577691    2566 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577694    2566 flags.go:64] FLAG: --feature-gates=""
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577697    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577700    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577703    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577706    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577709    2566 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577713    2566 flags.go:64] FLAG: --help="false"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577716    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577719    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577723    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577726    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577744    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577748    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577751    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577754    2566 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577757    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577760    2566 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577763    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577766    2566 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 17:08:34.584517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577769    2566 flags.go:64] FLAG: --kube-reserved=""
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577772    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577775    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577778    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577781    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577784    2566 flags.go:64] FLAG: --lock-file=""
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577787    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577790    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577793    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577797    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577800    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577803    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577806    2566 flags.go:64] FLAG: --logging-format="text"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577809    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577812    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577815    2566 flags.go:64] FLAG: --manifest-url=""
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577818    2566 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577821    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577824    2566 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577829    2566 flags.go:64] FLAG: --max-pods="110"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577832    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577836    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577840    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577842    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577845    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 17:08:34.585553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577848    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577852    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577858    2566 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577861    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577864    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577867    2566 flags.go:64] FLAG: --pod-cidr=""
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577871    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577876    2566 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577879    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577882    2566 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577885    2566 flags.go:64] FLAG: --port="10250"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577888    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577891    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-003899ffc8f0ca310"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577894    2566 flags.go:64] FLAG: --qos-reserved=""
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577898    2566 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577901    2566 flags.go:64] FLAG: --register-node="true"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577903    2566 flags.go:64] FLAG: --register-with-taints=""
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577907    2566 flags.go:64] FLAG: --registry-burst="10"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577910    2566 flags.go:64] FLAG: --registry-qps="5"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577913    2566 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577915    2566 flags.go:64] FLAG: --reserved-memory=""
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577919    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577922    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577925    2566 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577927    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 17:08:34.586504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577930    2566 flags.go:64] FLAG: --runonce="false"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577935    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577938    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577941    2566 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577944    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577949    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577953    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577956    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577959    2566 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577962    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577965    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577968    2566 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577970    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577973    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577976    2566 flags.go:64] FLAG: --system-cgroups=""
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577979    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577984    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577987    2566 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577990    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577994    2566 flags.go:64] FLAG: --tls-min-version=""
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577996    2566 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.577999    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578002    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578005    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578008    2566 flags.go:64] FLAG: --v="2"
Sep 07 17:08:34.587201 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578012    2566 flags.go:64] FLAG: --version="false"
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578015    2566 flags.go:64] FLAG: --vmodule=""
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578019    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578022    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578133    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578137    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578140    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578144    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578149    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578153    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578157    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578161    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578165    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578168    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578171    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578173    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578176    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578178    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578181    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578184    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 17:08:34.587834 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578187    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578189    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578192    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578194    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578197    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578199    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578202    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578204    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578207    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578210    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578213    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578215    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578218    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578221    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578223    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578226    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578228    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578231    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578233    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578236    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 17:08:34.588325 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578239    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578243    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578247    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578250    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578254    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578257    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578260    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578263    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578266    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578269    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578272    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578275    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578277    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578280    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578282    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578285    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578287    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578290    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578292    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 17:08:34.588853 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578295    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578297    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578300    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578304    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578307    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578311    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578313    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578316    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578319    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578321    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578324    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578326    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578329    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578331    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578334    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578336    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578339    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578342    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578345    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578347    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 17:08:34.589322 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578350    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578353    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578356    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578358    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578361    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578363    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578366    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578368    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578371    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578373    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578376    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578378    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578381    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578383    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578386    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578388    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578391    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578395    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578399    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578402    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 17:08:34.589844 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578404    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578407    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578410    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.578412    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.578418    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.587403    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.587418    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.587435    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.587441    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587497    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587503    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587507    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587510    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587513    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 17:08:34.590371 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587517    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587519    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587522    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587525    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587529    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587531    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587534    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587536    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587539    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587542    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587544    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587547    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587550    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587552    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587555    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587558    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587561    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587563    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587566    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587569    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 17:08:34.590718 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587572    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587574    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587576    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587579    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587581    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587585    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587587    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587590    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587593    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587595    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587598    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587601    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587603    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587606    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587608    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587611    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587615    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587619    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587622    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 17:08:34.591316 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587625    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587627    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587631    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587634    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587638    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587641    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587644    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587647    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587651    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587653    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587656    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587659    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587661    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587664    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587666    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587669    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587671    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587674    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587676    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587679    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 17:08:34.591837 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587681    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587684    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587687    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587690    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587692    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587695    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587712    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587716    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587720    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587723    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587726    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587742    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587745    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587747    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587750    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587753    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587756    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587758    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587761    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587764    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 17:08:34.592334 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587766    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587769    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587771    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587774    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587778    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587781    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587784    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587787    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587790    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587793    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587796    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587799    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587802    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587805    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 17:08:34.592951 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587808    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.587814    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587925    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587930    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587933    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587935    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587939    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587942    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587945    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587948    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587951    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587954    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587956    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587959    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 17:08:34.593306 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587962    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587965    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587967    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587970    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587973    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587975    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587978    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587980    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587983    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587985    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587988    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587990    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587993    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587995    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.587997    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588000    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588002    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588005    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588008    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 17:08:34.593830 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588011    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588014    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588018    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588021    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588024    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588026    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588029    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588032    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588034    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588037    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588040    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588042    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588045    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588047    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588051    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588054    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588056    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588058    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588061    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588063    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 17:08:34.594535 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588066    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588068    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588071    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588073    2566 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588076    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588078    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588080    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588083    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588085    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588088    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588091    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588093    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588096    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588098    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588101    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588104    2566 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588106    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588108    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588112    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588114    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 17:08:34.595160 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588117    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588119    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588121    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588124    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588126    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588129    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588131    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588135    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588137    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588139    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588142    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588145    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588147    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588150    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588152    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588154    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588157    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588160    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588163    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 17:08:34.595747 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588166    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588170    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588173    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588177    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588179    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588182    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588184    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588187    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:34.588190    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.588194    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.588292    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.591505    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.592353    2566 server.go:1019] "Starting client certificate rotation"
Sep 07 17:08:34.596235 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.592462    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 17:08:34.596578 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.592518    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 17:08:34.596578 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.595339    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 17:08:34.596578 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.596491    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 17:08:34.608556 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.608535    2566 log.go:25] "Validated CRI v1 runtime API"
Sep 07 17:08:34.612563 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.612546    2566 log.go:25] "Validated CRI v1 image API"
Sep 07 17:08:34.613414 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.613396    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 17:08:34.618062 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.618043    2566 fs.go:135] Filesystem UUIDs: map[12cbbcd6-7a62-4d62-b240-b20bcffdc947:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8daf3926-3344-4ee7-a892-f5cce5d5d6f5:/dev/nvme0n1p3]
Sep 07 17:08:34.618123 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.618061    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 17:08:34.625309 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.625138    2566 manager.go:216] Machine: {Timestamp:2026-09-07 17:08:34.622482118 +0000 UTC m=+0.359290543 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093925 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25acba6a30073f334fe142b57e68ec SystemUUID:ec25acba-6a30-073f-334f-e142b57e68ec BootID:6f23e1d2-8b63-411d-ae55-6edb1189d9c4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:4e:ff:5c:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:4e:ff:5c:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:31:16:19:45:e8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 17:08:34.625309 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.625299    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 17:08:34.625611 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.625590    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 17:08:34.628132 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.628116    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 17:08:34.630447 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.630421    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 17:08:34.630581 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.630452    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 17:08:34.631258 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.631247    2566 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 17:08:34.631299 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.631261    2566 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 17:08:34.631299 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.631269    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 17:08:34.632617 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.632607    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 17:08:34.634059 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.634050    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 17:08:34.637421 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637410    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 17:08:34.637534 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637524    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 17:08:34.637563 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637557    2566 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 17:08:34.637590 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637570    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 17:08:34.637590 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637589    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 17:08:34.637639 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637604    2566 kubelet.go:398] "Adding apiserver pod source"
Sep 07 17:08:34.637639 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.637616    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 17:08:34.638039 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.638028    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 17:08:34.638095 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.638047    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 17:08:34.641498 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.641481    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 17:08:34.644392 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644377    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 17:08:34.644446 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644409    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 17:08:34.644576 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644567    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 17:08:34.644605 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644585    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 17:08:34.644605 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644593    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 17:08:34.644605 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644599    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 17:08:34.644682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644606    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 17:08:34.644682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.644612    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 17:08:34.645187 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.645176    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 17:08:34.645224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.645187    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 17:08:34.645224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.645195    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 17:08:34.645224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.645201    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 17:08:34.645224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.645210    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 17:08:34.645224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.645219    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 17:08:34.645377 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.645354    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 17:08:34.645418 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.645402    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 17:08:34.646082 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.646070    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 17:08:34.646121 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.646092    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 17:08:34.648339 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.648319    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 17:08:34.648725 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.648710    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nccq4"
Sep 07 17:08:34.649891 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.649879    2566 server.go:1268] "Started kubelet"
Sep 07 17:08:34.650019 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.649967    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 17:08:34.650070 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.650042    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 17:08:34.650070 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.649996    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 17:08:34.650821 ip-10-0-138-5 systemd[1]: Started Kubernetes Kubelet.
Sep 07 17:08:34.651848 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.651365    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 17:08:34.653552 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.652528    2566 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 17:08:34.654759 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.654157    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nccq4"
Sep 07 17:08:34.655168 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.655126    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 17:08:34.655611 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.655594    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 17:08:34.655965 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.655941    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:34.656189 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.656147    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 17:08:34.656695 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.656677    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 17:08:34.656804 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.656776    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 17:08:34.656804 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.656792    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 17:08:34.656896 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.656862    2566 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 17:08:34.656896 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.656871    2566 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 17:08:34.657089 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657073    2566 factory.go:55] Registering systemd factory
Sep 07 17:08:34.657188 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657103    2566 factory.go:223] Registration of the systemd container factory successfully
Sep 07 17:08:34.657353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657340    2566 factory.go:153] Registering CRI-O factory
Sep 07 17:08:34.657412 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657361    2566 factory.go:223] Registration of the crio container factory successfully
Sep 07 17:08:34.657468 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657428    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 17:08:34.657468 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657449    2566 factory.go:103] Registering Raw factory
Sep 07 17:08:34.657468 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657463    2566 manager.go:1196] Started watching for new ooms in manager
Sep 07 17:08:34.657961 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.657942    2566 manager.go:349] Starting recovery of all containers
Sep 07 17:08:34.663789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.663592    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:08:34.667615 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.667582    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.670847 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.670830    2566 manager.go:354] Recovery completed
Sep 07 17:08:34.676620 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.676608    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.678511 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.678496    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.678574 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.678528    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.678574 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.678542    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.679256 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.679241    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 17:08:34.679256 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.679252    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 17:08:34.679345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.679268    2566 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 17:08:34.679345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.679270    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.680036 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.680018    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.680100 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.680054    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.680100 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.680069    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.680543 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.680531    2566 policy_none.go:49] "None policy: Start"
Sep 07 17:08:34.680582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.680547    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 17:08:34.680582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.680557    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 17:08:34.681808 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.681797    2566 policy_none.go:47] "Start"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.734314    2566 manager.go:337] "Starting Device Plugin manager"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.734350    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.734359    2566 server.go:87] "Starting device plugin registration server"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.734679    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.734690    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.735095    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.735175    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.735184    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.735693    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 17:08:34.739018 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.735792    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:34.764813 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.764786    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 17:08:34.765932 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.765916    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 17:08:34.765991 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.765976    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 17:08:34.766032 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.765997    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 17:08:34.766079 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.766041    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 17:08:34.768666 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.768650    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:08:34.835857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.835778    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.837020 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.836998    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.837180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.837030    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.837180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.837045    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.837180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.837073    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.846258 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.846236    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.846258 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.846258    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-5.ec2.internal\": node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:34.855640 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.855624    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:34.867050 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.867034    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"]
Sep 07 17:08:34.867109 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.867091    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.869532 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.869514    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.869609 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.869545    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.869609 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.869557    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.870996 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.870983    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.871125 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871112    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.871175 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871140    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.871744 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871713    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.871805 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871760    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.871805 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871772    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.871805 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871717    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.871893 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871813    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.871893 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.871824    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.872956 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.872941    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.873047 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.872963    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 17:08:34.873620 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.873606    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 17:08:34.873684 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.873633    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 17:08:34.873684 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.873647    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID"
Sep 07 17:08:34.904330 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.904306    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.908907 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.908891    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.956069 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:34.956042    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:34.958766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.958744    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1430f21aeb25f456980d7ace368f66b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"1430f21aeb25f456980d7ace368f66b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.958867 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.958772    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1430f21aeb25f456980d7ace368f66b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"1430f21aeb25f456980d7ace368f66b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:34.958867 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:34.958794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1b5fa4acea73087691552776422cf2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"e1b5fa4acea73087691552776422cf2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.056699 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.056663    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.059913 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.059880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1430f21aeb25f456980d7ace368f66b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"1430f21aeb25f456980d7ace368f66b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.059983 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.059921    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1b5fa4acea73087691552776422cf2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"e1b5fa4acea73087691552776422cf2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.059983 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.059942    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1430f21aeb25f456980d7ace368f66b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"1430f21aeb25f456980d7ace368f66b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.059983 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.059969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1b5fa4acea73087691552776422cf2b-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"e1b5fa4acea73087691552776422cf2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.060075 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.059980    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1430f21aeb25f456980d7ace368f66b4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"1430f21aeb25f456980d7ace368f66b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.060075 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.060019    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1430f21aeb25f456980d7ace368f66b4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"1430f21aeb25f456980d7ace368f66b4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.157445 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.157354    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.207704 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.207669    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.211763 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.211572    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:35.257630 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.257597    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.358033 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.358011    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.458482 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.458424    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.560155 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.560117    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.594015 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.593981    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 17:08:35.594492 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.594161    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 17:08:35.594492 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.594189    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 17:08:35.658989 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.658946    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 17:03:35 +0000 UTC" deadline="2028-06-17 05:46:43.143317338 +0000 UTC"
Sep 07 17:08:35.658989 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.658979    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15564h38m7.484341527s"
Sep 07 17:08:35.660478 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.660450    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.685167 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.683762    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:08:35.760955 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.760886    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.844220 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:35.844177    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b5fa4acea73087691552776422cf2b.slice/crio-3fa72f5974c73ca1f4a6c48a068ce011542bce62d32bcb4ebda35ffa6e4845f2 WatchSource:0}: Error finding container 3fa72f5974c73ca1f4a6c48a068ce011542bce62d32bcb4ebda35ffa6e4845f2: Status 404 returned error can't find the container with id 3fa72f5974c73ca1f4a6c48a068ce011542bce62d32bcb4ebda35ffa6e4845f2
Sep 07 17:08:35.844491 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:35.844466    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1430f21aeb25f456980d7ace368f66b4.slice/crio-65a5e1ba16b0bf7a817bf4fa55fc81a943842417552f552e7b6e8ce7d1734fb2 WatchSource:0}: Error finding container 65a5e1ba16b0bf7a817bf4fa55fc81a943842417552f552e7b6e8ce7d1734fb2: Status 404 returned error can't find the container with id 65a5e1ba16b0bf7a817bf4fa55fc81a943842417552f552e7b6e8ce7d1734fb2
Sep 07 17:08:35.849897 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:35.849873    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:08:35.861612 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.861594    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:35.962777 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:35.962748    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:36.063049 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.062971    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found"
Sep 07 17:08:36.090196 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.090175    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:08:36.156580 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.156552    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:36.171563 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.171541    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 17:08:36.172687 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.172673    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"
Sep 07 17:08:36.183598 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.183567    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 17:08:36.440282 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.440168    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:08:36.638806 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.638761    2566 apiserver.go:52] "Watching apiserver"
Sep 07 17:08:36.650356 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.650191    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 17:08:36.650652 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.650624    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-j8w5l","openshift-image-registry/node-ca-tnsjj","openshift-multus/multus-additional-cni-plugins-sgvmz","openshift-multus/multus-wjhtl","kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t","openshift-dns/node-resolver-28qbv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal","openshift-multus/network-metrics-daemon-84kp7","openshift-network-diagnostics/network-check-target-ktvgz","openshift-network-operator/iptables-alerter-hs8fc","openshift-ovn-kubernetes/ovnkube-node-q5vrn","kube-system/global-pull-secret-syncer-7wvtk","kube-system/konnectivity-agent-ww7jf"]
Sep 07 17:08:36.652767 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.652467    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.654512 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.654184    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.655698 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.655553    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.655698 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.655605    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.656033 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.655901    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bbvbx\""
Sep 07 17:08:36.656033 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.655934    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 17:08:36.656610 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.656583    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.656781 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.656720    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.657411 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.657346    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.657631 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.657608    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rjcsb\""
Sep 07 17:08:36.658490 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.658467    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 17:08:36.659095 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.659074    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w6zsh\""
Sep 07 17:08:36.659456 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.659438    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.659743 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.659727    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 17:08:36.659920 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.659903    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.660188 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.660171    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 17:08:36.660353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.660338    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 17:08:36.660420 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.660354    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.661413 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.661393    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.662208 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.662187    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 17:08:36.662634 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.662615    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7q2tx\""
Sep 07 17:08:36.664266 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.664242    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.664381 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.664364    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6s8dq\""
Sep 07 17:08:36.664913 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.664565    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 17:08:36.664913 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.664748    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 17:08:36.665917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.665899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:36.666026 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.665993    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:36.667015 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.666838    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.667355 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.667214    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 17:08:36.667355 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.667251    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pm6bs\""
Sep 07 17:08:36.667355 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.667323    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.667561 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.667546    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.667662 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.667614    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:36.668958 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.668931    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cnibin\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.669036 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.668979    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-cni-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669036 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669009    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-cni-bin\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669114 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-kubelet\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669114 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-conf-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669114 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669093    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-multus-certs\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669219 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-system-cni-dir\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.669219 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669151    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.669219 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669189    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-cni-multus\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669327 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85cgr\" (UniqueName: \"kubernetes.io/projected/78dade0d-191e-411d-822b-e420615d648e-kube-api-access-85cgr\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669327 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669246    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j4wq\" (UniqueName: \"kubernetes.io/projected/e45a50fa-ca6f-4298-9807-9964c6ae62a3-kube-api-access-4j4wq\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.669327 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669275    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22ce17bd-3a00-409e-8faf-06c0e0568ba5-iptables-alerter-script\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.669327 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22ce17bd-3a00-409e-8faf-06c0e0568ba5-host-slash\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.669494 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669327    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-etc-kubernetes\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669494 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-cnibin\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669494 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-socket-dir-parent\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669494 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669448    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-k8s-cni-cncf-io\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669697 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e45a50fa-ca6f-4298-9807-9964c6ae62a3-hosts-file\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.669697 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669531    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e45a50fa-ca6f-4298-9807-9964c6ae62a3-tmp-dir\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.669697 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669569    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-system-cni-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669697 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669611    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-netns\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669697 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.669967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669692    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78dade0d-191e-411d-822b-e420615d648e-cni-binary-copy\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78dade0d-191e-411d-822b-e420615d648e-multus-daemon-config\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.669967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669883    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.669967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669897    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.669967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.669936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.670543 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.670512    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2d8\" (UniqueName: \"kubernetes.io/projected/2e4de1cd-2af1-4d98-be48-9713f59c41d6-kube-api-access-hn2d8\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.672027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.671999    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-hostroot\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.672115 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.672045    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mldn\" (UniqueName: \"kubernetes.io/projected/22ce17bd-3a00-409e-8faf-06c0e0568ba5-kube-api-access-4mldn\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.672987 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.672964    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:36.673090 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.673050    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:36.673576 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.673550    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 17:08:36.674944 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.673823    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.674944 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.674133    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.675507 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.675280    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.676483 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.676010    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 17:08:36.676483 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.676154    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sjvkg\""
Sep 07 17:08:36.677918 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.677336    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.678899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.678876    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.679094 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.679070    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2bv9\""
Sep 07 17:08:36.680072 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.680049    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.680677 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.680656    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 17:08:36.680677 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.680669    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 17:08:36.680836 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.680793    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2mbcw\""
Sep 07 17:08:36.681474 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.681453    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 17:08:36.681608 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.681587    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 17:08:36.681676 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.681668    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 17:08:36.681766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.681458    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 17:08:36.702698 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.702672    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pv9d5"
Sep 07 17:08:36.708857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.708827    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pv9d5"
Sep 07 17:08:36.757864 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.757835    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 17:08:36.771384 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.771343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" event={"ID":"e1b5fa4acea73087691552776422cf2b","Type":"ContainerStarted","Data":"3fa72f5974c73ca1f4a6c48a068ce011542bce62d32bcb4ebda35ffa6e4845f2"}
Sep 07 17:08:36.772254 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-system-cni-dir\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.772383 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.772383 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-modprobe-d\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.772383 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772333    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysctl-d\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.772383 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772349    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-system-cni-dir\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.772383 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772369    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-ovnkube-config\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772408    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-env-overrides\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772442    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85cgr\" (UniqueName: \"kubernetes.io/projected/78dade0d-191e-411d-822b-e420615d648e-kube-api-access-85cgr\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772470    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j4wq\" (UniqueName: \"kubernetes.io/projected/e45a50fa-ca6f-4298-9807-9964c6ae62a3-kube-api-access-4j4wq\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hq28\" (UniqueName: \"kubernetes.io/projected/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-kube-api-access-2hq28\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772528    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22ce17bd-3a00-409e-8faf-06c0e0568ba5-host-slash\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772577    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-etc-kubernetes\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772615    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.772660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-cnibin\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772670    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e45a50fa-ca6f-4298-9807-9964c6ae62a3-tmp-dir\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xpz\" (UniqueName: \"kubernetes.io/projected/570cf421-60b5-465e-b96b-53bead8eae68-kube-api-access-m6xpz\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-systemd\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-systemd-units\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772807    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-systemd\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772854    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-etc-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772843    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-etc-kubernetes\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-ovn\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772943    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.772986    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773043    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-cnibin\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.773079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773052    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9af5a907-61fa-4bff-8db9-b8cba41d9b3a-konnectivity-ca\") pod \"konnectivity-agent-ww7jf\" (UID: \"9af5a907-61fa-4bff-8db9-b8cba41d9b3a\") " pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773095    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22ce17bd-3a00-409e-8faf-06c0e0568ba5-host-slash\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773136    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-kubelet\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-var-lib-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773294    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e45a50fa-ca6f-4298-9807-9964c6ae62a3-tmp-dir\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773296    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2d8\" (UniqueName: \"kubernetes.io/projected/2e4de1cd-2af1-4d98-be48-9713f59c41d6-kube-api-access-hn2d8\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773446    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"1430f21aeb25f456980d7ace368f66b4","Type":"ContainerStarted","Data":"65a5e1ba16b0bf7a817bf4fa55fc81a943842417552f552e7b6e8ce7d1734fb2"}
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773461    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-hostroot\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773561    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-hostroot\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-sys-fs\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.773663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773619    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cd4e148-ac61-48fa-926b-d62caac17041-etc-tuned\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-run-netns\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773742    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773773    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mldn\" (UniqueName: \"kubernetes.io/projected/22ce17bd-3a00-409e-8faf-06c0e0568ba5-kube-api-access-4mldn\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773823    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-kubelet\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773859    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-multus-certs\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773884    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-kubelet\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-etc-selinux\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773934    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-multus-certs\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773924    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67260cc8-cddb-49f8-beda-24d582982b53-ovn-node-metrics-cert\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.773973    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-cni-multus\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774012    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-socket-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774040    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-ovnkube-script-lib\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-cni-multus\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774074    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-kubelet-config\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-kubernetes\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.774326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774161    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22ce17bd-3a00-409e-8faf-06c0e0568ba5-iptables-alerter-script\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-dbus\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774237    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-host\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774261    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-node-log\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-log-socket\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-cni-netd\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774333    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-socket-dir-parent\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774359    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-k8s-cni-cncf-io\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774385    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e45a50fa-ca6f-4298-9807-9964c6ae62a3-hosts-file\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774408    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-device-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-socket-dir-parent\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-sys\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-k8s-cni-cncf-io\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774497    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-lib-modules\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774502    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e45a50fa-ca6f-4298-9807-9964c6ae62a3-hosts-file\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.775179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774523    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cd4e148-ac61-48fa-926b-d62caac17041-tmp\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-system-cni-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774582    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-netns\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774606    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-serviceca\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774630    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-var-lib-kubelet\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774683    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22ce17bd-3a00-409e-8faf-06c0e0568ba5-iptables-alerter-script\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774706    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-run-netns\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774729    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-cni-bin\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774758    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86sfs\" (UniqueName: \"kubernetes.io/projected/67260cc8-cddb-49f8-beda-24d582982b53-kube-api-access-86sfs\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774771    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-system-cni-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774790    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774832    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78dade0d-191e-411d-822b-e420615d648e-cni-binary-copy\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774847    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78dade0d-191e-411d-822b-e420615d648e-multus-daemon-config\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774865    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-registration-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774888    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9af5a907-61fa-4bff-8db9-b8cba41d9b3a-agent-certs\") pod \"konnectivity-agent-ww7jf\" (UID: \"9af5a907-61fa-4bff-8db9-b8cba41d9b3a\") " pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774915    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.775941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.774987    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysctl-conf\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-run\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775298    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-642x7\" (UniqueName: \"kubernetes.io/projected/8cd4e148-ac61-48fa-926b-d62caac17041-kube-api-access-642x7\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cnibin\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775384    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-cni-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775400    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cnibin\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775438    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-cni-bin\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-cni-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-conf-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775557    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-multus-conf-dir\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775604    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kt8w\" (UniqueName: \"kubernetes.io/projected/2736a459-1c6a-4d22-88da-e56f248f4c09-kube-api-access-7kt8w\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775643    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-host\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775670    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78dade0d-191e-411d-822b-e420615d648e-host-var-lib-cni-bin\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775680    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysconfig\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e4de1cd-2af1-4d98-be48-9713f59c41d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775707    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-slash\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.776536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775737    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78dade0d-191e-411d-822b-e420615d648e-cni-binary-copy\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.777136 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.775737    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78dade0d-191e-411d-822b-e420615d648e-multus-daemon-config\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.780075 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.780038    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 17:08:36.784986 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.784852    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j4wq\" (UniqueName: \"kubernetes.io/projected/e45a50fa-ca6f-4298-9807-9964c6ae62a3-kube-api-access-4j4wq\") pod \"node-resolver-28qbv\" (UID: \"e45a50fa-ca6f-4298-9807-9964c6ae62a3\") " pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.785113 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.784853    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2d8\" (UniqueName: \"kubernetes.io/projected/2e4de1cd-2af1-4d98-be48-9713f59c41d6-kube-api-access-hn2d8\") pod \"multus-additional-cni-plugins-sgvmz\" (UID: \"2e4de1cd-2af1-4d98-be48-9713f59c41d6\") " pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.785113 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.784859    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mldn\" (UniqueName: \"kubernetes.io/projected/22ce17bd-3a00-409e-8faf-06c0e0568ba5-kube-api-access-4mldn\") pod \"iptables-alerter-hs8fc\" (UID: \"22ce17bd-3a00-409e-8faf-06c0e0568ba5\") " pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.785113 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.784889    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85cgr\" (UniqueName: \"kubernetes.io/projected/78dade0d-191e-411d-822b-e420615d648e-kube-api-access-85cgr\") pod \"multus-wjhtl\" (UID: \"78dade0d-191e-411d-822b-e420615d648e\") " pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:36.876504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876463    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-registration-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.876504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9af5a907-61fa-4bff-8db9-b8cba41d9b3a-agent-certs\") pod \"konnectivity-agent-ww7jf\" (UID: \"9af5a907-61fa-4bff-8db9-b8cba41d9b3a\") " pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysctl-conf\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876565    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-run\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-642x7\" (UniqueName: \"kubernetes.io/projected/8cd4e148-ac61-48fa-926b-d62caac17041-kube-api-access-642x7\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876625    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kt8w\" (UniqueName: \"kubernetes.io/projected/2736a459-1c6a-4d22-88da-e56f248f4c09-kube-api-access-7kt8w\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876628    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-registration-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876649    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-host\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876691    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-host\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876691    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysconfig\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876734    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysconfig\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876737    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-slash\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876788    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-modprobe-d\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876792    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-slash\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876818    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysctl-d\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.876845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876847    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-ovnkube-config\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876875    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-env-overrides\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hq28\" (UniqueName: \"kubernetes.io/projected/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-kube-api-access-2hq28\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876912    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-modprobe-d\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876934    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xpz\" (UniqueName: \"kubernetes.io/projected/570cf421-60b5-465e-b96b-53bead8eae68-kube-api-access-m6xpz\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.876988    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-systemd\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-systemd-units\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-systemd\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877077    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-etc-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877105    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-ovn\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9af5a907-61fa-4bff-8db9-b8cba41d9b3a-konnectivity-ca\") pod \"konnectivity-agent-ww7jf\" (UID: \"9af5a907-61fa-4bff-8db9-b8cba41d9b3a\") " pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877182    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-kubelet\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877206    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-var-lib-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysctl-conf\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.877549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877261    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-sys-fs\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-systemd-units\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cd4e148-ac61-48fa-926b-d62caac17041-etc-tuned\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877309    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-run\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877326    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-run-netns\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877360    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-etc-selinux\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877388    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67260cc8-cddb-49f8-beda-24d582982b53-ovn-node-metrics-cert\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877416    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-socket-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877459    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-ovnkube-script-lib\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-kubelet-config\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877564    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-kubernetes\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877630    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-dbus\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-sysctl-d\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877690    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-host\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877751    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-node-log\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.878426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877780    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-log-socket\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-cni-netd\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-device-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877900    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-sys\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877951    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-lib-modules\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.877977    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cd4e148-ac61-48fa-926b-d62caac17041-tmp\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878007    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-serviceca\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878042    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-var-lib-kubelet\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-cni-bin\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878136    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86sfs\" (UniqueName: \"kubernetes.io/projected/67260cc8-cddb-49f8-beda-24d582982b53-kube-api-access-86sfs\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878198    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-env-overrides\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878265    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-ovnkube-config\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.878318    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-sys\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.878402    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:37.378371088 +0000 UTC m=+3.115179483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:36.879353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878404    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-host\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878454    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-run-ovn-kubernetes\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878497    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-node-log\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878527    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-lib-modules\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878547    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-log-socket\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878609    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-device-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.878693    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878711    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-systemd\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.878754    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:37.378737177 +0000 UTC m=+3.115545584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878758    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-run-netns\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878825    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-kubelet-config\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.878921    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-etc-selinux\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-etc-kubernetes\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879070    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-dbus\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879454    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-systemd\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd4e148-ac61-48fa-926b-d62caac17041-var-lib-kubelet\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879506    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-etc-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.880400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879538    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879567    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879586    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-cni-bin\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879618    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-var-lib-openvswitch\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879642    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-sys-fs\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879693    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-cni-netd\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/570cf421-60b5-465e-b96b-53bead8eae68-socket-dir\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-run-ovn\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879833    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9af5a907-61fa-4bff-8db9-b8cba41d9b3a-konnectivity-ca\") pod \"konnectivity-agent-ww7jf\" (UID: \"9af5a907-61fa-4bff-8db9-b8cba41d9b3a\") " pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879861    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-kubelet\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879894    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-serviceca\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.879905    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67260cc8-cddb-49f8-beda-24d582982b53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.880025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8cd4e148-ac61-48fa-926b-d62caac17041-etc-tuned\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.880269    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/67260cc8-cddb-49f8-beda-24d582982b53-ovnkube-script-lib\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.881302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.880745    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9af5a907-61fa-4bff-8db9-b8cba41d9b3a-agent-certs\") pod \"konnectivity-agent-ww7jf\" (UID: \"9af5a907-61fa-4bff-8db9-b8cba41d9b3a\") " pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:36.882050 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.881777    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8cd4e148-ac61-48fa-926b-d62caac17041-tmp\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.882208 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.882187    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/67260cc8-cddb-49f8-beda-24d582982b53-ovn-node-metrics-cert\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.893282 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.893259    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:08:36.893282 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.893285    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:08:36.893464 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.893300    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:36.893464 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:36.893401    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:37.393382511 +0000 UTC m=+3.130190917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:36.894536 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.894508    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kt8w\" (UniqueName: \"kubernetes.io/projected/2736a459-1c6a-4d22-88da-e56f248f4c09-kube-api-access-7kt8w\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:36.896311 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.896279    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xpz\" (UniqueName: \"kubernetes.io/projected/570cf421-60b5-465e-b96b-53bead8eae68-kube-api-access-m6xpz\") pod \"aws-ebs-csi-driver-node-zh29t\" (UID: \"570cf421-60b5-465e-b96b-53bead8eae68\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:36.896509 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.896483    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-642x7\" (UniqueName: \"kubernetes.io/projected/8cd4e148-ac61-48fa-926b-d62caac17041-kube-api-access-642x7\") pod \"tuned-j8w5l\" (UID: \"8cd4e148-ac61-48fa-926b-d62caac17041\") " pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:36.896939 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.896919    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86sfs\" (UniqueName: \"kubernetes.io/projected/67260cc8-cddb-49f8-beda-24d582982b53-kube-api-access-86sfs\") pod \"ovnkube-node-q5vrn\" (UID: \"67260cc8-cddb-49f8-beda-24d582982b53\") " pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:36.898229 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.898199    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hq28\" (UniqueName: \"kubernetes.io/projected/4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d-kube-api-access-2hq28\") pod \"node-ca-tnsjj\" (UID: \"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d\") " pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:36.968002 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.967917    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-28qbv"
Sep 07 17:08:36.981466 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.981444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hs8fc"
Sep 07 17:08:36.990870 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.990841    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sgvmz"
Sep 07 17:08:36.997850 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:36.997833    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wjhtl"
Sep 07 17:08:37.003982 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.003957    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:08:37.009853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.009829    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t"
Sep 07 17:08:37.015874 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.015856    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tnsjj"
Sep 07 17:08:37.022861 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.022843    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j8w5l"
Sep 07 17:08:37.027901 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.027878    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:08:37.168907 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.168877    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 17:08:37.382150 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.382075    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:37.382150 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.382115    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:37.382318 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.382214    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:37.382318 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.382217    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:37.382318 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.382272    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:38.382257233 +0000 UTC m=+4.119065624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:37.382318 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.382285    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:38.382278673 +0000 UTC m=+4.119087064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:37.483127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.483085    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:37.483327 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.483304    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:08:37.483402 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.483336    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:08:37.483402 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.483352    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:37.483488 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.483422    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:38.483402527 +0000 UTC m=+4.220210923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:37.711543 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.711439    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 17:03:37 +0000 UTC" deadline="2028-06-23 21:03:05.32703479 +0000 UTC"
Sep 07 17:08:37.711543 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.711481    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15723h54m27.615558265s"
Sep 07 17:08:37.766721 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.766529    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:37.766721 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:37.766661    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:37.771412 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.771383    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67260cc8_cddb_49f8_beda_24d582982b53.slice/crio-579e44c19f84d476e15276da1bd0397b2d6c82a897a60597a3ed36822cf51c4f WatchSource:0}: Error finding container 579e44c19f84d476e15276da1bd0397b2d6c82a897a60597a3ed36822cf51c4f: Status 404 returned error can't find the container with id 579e44c19f84d476e15276da1bd0397b2d6c82a897a60597a3ed36822cf51c4f
Sep 07 17:08:37.772971 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.772904    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dade0d_191e_411d_822b_e420615d648e.slice/crio-bfd5fabe60347709eea33f265c94973f1f8ec4044ac32e146e4214c219c998b2 WatchSource:0}: Error finding container bfd5fabe60347709eea33f265c94973f1f8ec4044ac32e146e4214c219c998b2: Status 404 returned error can't find the container with id bfd5fabe60347709eea33f265c94973f1f8ec4044ac32e146e4214c219c998b2
Sep 07 17:08:37.774184 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.774131    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ce17bd_3a00_409e_8faf_06c0e0568ba5.slice/crio-e2821101af67e49bd5038439f2276bae0de77c546c6299a996b4ef1a4c5231e1 WatchSource:0}: Error finding container e2821101af67e49bd5038439f2276bae0de77c546c6299a996b4ef1a4c5231e1: Status 404 returned error can't find the container with id e2821101af67e49bd5038439f2276bae0de77c546c6299a996b4ef1a4c5231e1
Sep 07 17:08:37.777779 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.776626    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wjhtl" event={"ID":"78dade0d-191e-411d-822b-e420615d648e","Type":"ContainerStarted","Data":"bfd5fabe60347709eea33f265c94973f1f8ec4044ac32e146e4214c219c998b2"}
Sep 07 17:08:37.777779 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.777320    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570cf421_60b5_465e_b96b_53bead8eae68.slice/crio-21ed7da9082e1572ab34b75fffc2d8afcb064c86c56d5d80fbb177c60c45eefc WatchSource:0}: Error finding container 21ed7da9082e1572ab34b75fffc2d8afcb064c86c56d5d80fbb177c60c45eefc: Status 404 returned error can't find the container with id 21ed7da9082e1572ab34b75fffc2d8afcb064c86c56d5d80fbb177c60c45eefc
Sep 07 17:08:37.778051 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:37.778033    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"579e44c19f84d476e15276da1bd0397b2d6c82a897a60597a3ed36822cf51c4f"}
Sep 07 17:08:37.779508 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.779046    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd4e148_ac61_48fa_926b_d62caac17041.slice/crio-3f0e85742b99acfbd5a2ac966ecd0453ac2aecbf2bde605f76b7c05b2155501a WatchSource:0}: Error finding container 3f0e85742b99acfbd5a2ac966ecd0453ac2aecbf2bde605f76b7c05b2155501a: Status 404 returned error can't find the container with id 3f0e85742b99acfbd5a2ac966ecd0453ac2aecbf2bde605f76b7c05b2155501a
Sep 07 17:08:37.779977 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.779729    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4de1cd_2af1_4d98_be48_9713f59c41d6.slice/crio-6f7d7c7cb990966aba3972a5ab3749384e9b4f3e0d602bb32e0b66eba3be58e6 WatchSource:0}: Error finding container 6f7d7c7cb990966aba3972a5ab3749384e9b4f3e0d602bb32e0b66eba3be58e6: Status 404 returned error can't find the container with id 6f7d7c7cb990966aba3972a5ab3749384e9b4f3e0d602bb32e0b66eba3be58e6
Sep 07 17:08:37.780857 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.780730    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af5a907_61fa_4bff_8db9_b8cba41d9b3a.slice/crio-875027ab91761fbffd14dfaadc515e55886b344118a3f0c682fecded867fe8c9 WatchSource:0}: Error finding container 875027ab91761fbffd14dfaadc515e55886b344118a3f0c682fecded867fe8c9: Status 404 returned error can't find the container with id 875027ab91761fbffd14dfaadc515e55886b344118a3f0c682fecded867fe8c9
Sep 07 17:08:37.782178 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.782064    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9b6049_4fb2_4c3f_b9f3_31e2069cc55d.slice/crio-d8cd66b3a823da319b220b7b2e66244a98cd6272fa7213504f5f9894a830e76e WatchSource:0}: Error finding container d8cd66b3a823da319b220b7b2e66244a98cd6272fa7213504f5f9894a830e76e: Status 404 returned error can't find the container with id d8cd66b3a823da319b220b7b2e66244a98cd6272fa7213504f5f9894a830e76e
Sep 07 17:08:37.783728 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:08:37.783479    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45a50fa_ca6f_4298_9807_9964c6ae62a3.slice/crio-165faf0b17dab26e6b8fc430966d1de42531550893d21b118216fd2134882701 WatchSource:0}: Error finding container 165faf0b17dab26e6b8fc430966d1de42531550893d21b118216fd2134882701: Status 404 returned error can't find the container with id 165faf0b17dab26e6b8fc430966d1de42531550893d21b118216fd2134882701
Sep 07 17:08:38.390943 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.390845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:38.390943 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.390910    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:38.391189 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.391077    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:38.391189 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.391148    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:40.391126133 +0000 UTC m=+6.127934532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:38.391601 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.391569    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:38.391709 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.391624    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:40.391609101 +0000 UTC m=+6.128417500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:38.491617 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.491573    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:38.491834 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.491808    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:08:38.491834 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.491832    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:08:38.491977 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.491846    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:38.491977 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.491910    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:40.491890352 +0000 UTC m=+6.228698750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:38.712123 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.711967    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 17:03:37 +0000 UTC" deadline="2028-05-26 04:48:44.112170546 +0000 UTC"
Sep 07 17:08:38.712123 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.712033    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15035h40m5.400142205s"
Sep 07 17:08:38.768838 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.768776    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:38.769023 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.768935    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:38.769410 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.769383    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:38.769532 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:38.769509    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:38.787154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.787118    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hs8fc" event={"ID":"22ce17bd-3a00-409e-8faf-06c0e0568ba5","Type":"ContainerStarted","Data":"e2821101af67e49bd5038439f2276bae0de77c546c6299a996b4ef1a4c5231e1"}
Sep 07 17:08:38.789389 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.789316    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tnsjj" event={"ID":"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d","Type":"ContainerStarted","Data":"d8cd66b3a823da319b220b7b2e66244a98cd6272fa7213504f5f9894a830e76e"}
Sep 07 17:08:38.792883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.792778    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28qbv" event={"ID":"e45a50fa-ca6f-4298-9807-9964c6ae62a3","Type":"ContainerStarted","Data":"165faf0b17dab26e6b8fc430966d1de42531550893d21b118216fd2134882701"}
Sep 07 17:08:38.802529 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.802475    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerStarted","Data":"6f7d7c7cb990966aba3972a5ab3749384e9b4f3e0d602bb32e0b66eba3be58e6"}
Sep 07 17:08:38.812524 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.812490    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ww7jf" event={"ID":"9af5a907-61fa-4bff-8db9-b8cba41d9b3a","Type":"ContainerStarted","Data":"875027ab91761fbffd14dfaadc515e55886b344118a3f0c682fecded867fe8c9"}
Sep 07 17:08:38.824923 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.822543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t" event={"ID":"570cf421-60b5-465e-b96b-53bead8eae68","Type":"ContainerStarted","Data":"21ed7da9082e1572ab34b75fffc2d8afcb064c86c56d5d80fbb177c60c45eefc"}
Sep 07 17:08:38.833645 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.833289    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" event={"ID":"e1b5fa4acea73087691552776422cf2b","Type":"ContainerStarted","Data":"56157cef124842ecb600000d01b13a698ab59fd85a22bb6d0a54a2c8da9beceb"}
Sep 07 17:08:38.853365 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.852545    2566 generic.go:356] "Generic (PLEG): container finished" podID="1430f21aeb25f456980d7ace368f66b4" containerID="34ffcb8c2d9870e9317d6aa5d6ee5297642fefa81053a5877be0f42ceae1849d" exitCode=0
Sep 07 17:08:38.853365 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.852627    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"1430f21aeb25f456980d7ace368f66b4","Type":"ContainerDied","Data":"34ffcb8c2d9870e9317d6aa5d6ee5297642fefa81053a5877be0f42ceae1849d"}
Sep 07 17:08:38.869103 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.868493    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" podStartSLOduration=2.8684744909999997 podStartE2EDuration="2.868474491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:38.848459641 +0000 UTC m=+4.585268058" watchObservedRunningTime="2026-09-07 17:08:38.868474491 +0000 UTC m=+4.605282909"
Sep 07 17:08:38.875632 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:38.874977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j8w5l" event={"ID":"8cd4e148-ac61-48fa-926b-d62caac17041","Type":"ContainerStarted","Data":"3f0e85742b99acfbd5a2ac966ecd0453ac2aecbf2bde605f76b7c05b2155501a"}
Sep 07 17:08:39.767031 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:39.766998    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:39.767582 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:39.767148    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:39.890953 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:39.890877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"1430f21aeb25f456980d7ace368f66b4","Type":"ContainerStarted","Data":"8cd5853e267aa9fdc58fcf2a40353f19f8db8568f62fdefe46d5e4b372b65b67"}
Sep 07 17:08:40.410106 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:40.410069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:40.410307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:40.410121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:40.410307 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.410234    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:40.410418 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.410329    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:44.410276864 +0000 UTC m=+10.147085271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:40.410764 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.410744    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:40.410901 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.410800    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:44.410782458 +0000 UTC m=+10.147590867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:40.511081 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:40.511046    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:40.511496 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.511271    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:08:40.511496 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.511301    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:08:40.511496 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.511313    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:40.511496 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.511373    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:44.511353442 +0000 UTC m=+10.248161856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:40.769875 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:40.769769    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:40.770341 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.769951    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:40.770403 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:40.770392    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:40.770506 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:40.770481    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:41.766645 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:41.766608    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:41.766870 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:41.766774    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:42.767426 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:42.767087    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:42.767426 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:42.767230    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:42.767905 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:42.767597    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:42.767905 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:42.767683    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:43.767440 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:43.766765    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:43.767440 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:43.767103    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:44.444700 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:44.444660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:44.444907 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:44.444719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:44.444907 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.444851    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:44.444907 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.444865    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:44.445067 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.444924    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:52.444905082 +0000 UTC m=+18.181713475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:44.445067 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.444945    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:52.444934504 +0000 UTC m=+18.181742899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:44.546010 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:44.545762    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:44.546010 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.546008    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:08:44.546234 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.546028    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:08:44.546234 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.546041    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:44.546234 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.546095    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:08:52.546077727 +0000 UTC m=+18.282886133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:44.769155 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:44.768398    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:44.769155 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.768514    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:44.769155 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:44.768897    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:44.769155 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:44.769039    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:45.766485 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:45.766451    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:45.766679 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:45.766573    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:46.770248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:46.770216    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:46.770248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:46.770244    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:46.770766 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:46.770362    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:46.770766 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:46.770484    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:47.766836 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:47.766802    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:47.767000 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:47.766924    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:48.766257 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:48.766226    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:48.766684 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:48.766239    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:48.766684 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:48.766378    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:48.766684 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:48.766427    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:49.766461 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:49.766426    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:49.766948 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:49.766549    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:50.767007 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:50.766970    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:50.767401 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:50.766970    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:50.767401 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:50.767108    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:50.767401 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:50.767201    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:51.766769 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:51.766723    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:51.766967 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:51.766848    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:52.506381 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:52.506337    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:52.506854 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:52.506392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:52.506854 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.506492    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:52.506854 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.506574    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:08.506554148 +0000 UTC m=+34.243362552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:08:52.506854 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.506498    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:52.506854 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.506647    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:08.506631519 +0000 UTC m=+34.243439926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:08:52.606916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:52.606864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:52.607098 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.607058    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:08:52.607098 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.607087    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:08:52.607098 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.607099    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:52.607238 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.607167    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:08.607147419 +0000 UTC m=+34.343955827 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:08:52.766811 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:52.766711    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:52.766811 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:52.766775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:52.767012 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.766869    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:52.767012 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:52.766955    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:53.766317 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:53.766287    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:53.766728 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:53.766437    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:54.767290 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:54.767259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:54.767718 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:54.767377    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:54.767718 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:54.767414    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:54.767718 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:54.767478    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:55.767899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.767273    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:55.767899 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:55.767380    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:55.930694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.930661    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"039521b3e4199498d95266ca600139aeb0835e077a776fc5f826d751cdb8612d"}
Sep 07 17:08:55.930891 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.930789    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"a63f1d7e98b659c1f81c586de29b6c039bc68771b55d6e590fc10e52298f6db6"}
Sep 07 17:08:55.932560 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.932528    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j8w5l" event={"ID":"8cd4e148-ac61-48fa-926b-d62caac17041","Type":"ContainerStarted","Data":"0b5a28e7c1b1aae90e3cd6c99e5ca964fcff40d1a6495d041741e99ee01c9621"}
Sep 07 17:08:55.934247 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.934223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wjhtl" event={"ID":"78dade0d-191e-411d-822b-e420615d648e","Type":"ContainerStarted","Data":"6ce9c36c7cde2d80e8743a2196174f032d3863c76254ce29d4990af17d00d406"}
Sep 07 17:08:55.936239 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.935909    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tnsjj" event={"ID":"4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d","Type":"ContainerStarted","Data":"ea07160b5ab63800d39b79a106af4e93860b313cf9adeae41f56a6cb017fdb34"}
Sep 07 17:08:55.937708 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.937621    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-28qbv" event={"ID":"e45a50fa-ca6f-4298-9807-9964c6ae62a3","Type":"ContainerStarted","Data":"c0fc1adead3d4d3a7e768f9e4267aaa88c8b70f3bcea74996ea59d560c75a61a"}
Sep 07 17:08:55.939389 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.939368    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e4de1cd-2af1-4d98-be48-9713f59c41d6" containerID="31ccc1e9cc1b4007c60ac7e32ac87a88d37830a3fed787dd749f5d49d83885d9" exitCode=0
Sep 07 17:08:55.939469 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.939433    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerDied","Data":"31ccc1e9cc1b4007c60ac7e32ac87a88d37830a3fed787dd749f5d49d83885d9"}
Sep 07 17:08:55.941471 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.941377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ww7jf" event={"ID":"9af5a907-61fa-4bff-8db9-b8cba41d9b3a","Type":"ContainerStarted","Data":"23ec6fb6fd8d4c70e6723fa77000df7884476d9306b266846fb96b05d97cab63"}
Sep 07 17:08:55.945650 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.945620    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t" event={"ID":"570cf421-60b5-465e-b96b-53bead8eae68","Type":"ContainerStarted","Data":"4acdda7e165ac2de5847e79adfc676f7516a8142158a5f0c759a34a9bfc6dddf"}
Sep 07 17:08:55.956504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.956461    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j8w5l" podStartSLOduration=3.154989133 podStartE2EDuration="20.956427105s" totalImagesPullingTime="17.801437972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:55.956358896 +0000 UTC m=+21.693167312" watchObservedRunningTime="2026-09-07 17:08:55.956427105 +0000 UTC m=+21.693235515"
Sep 07 17:08:55.956925 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.956899    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" podStartSLOduration=19.956888905 podStartE2EDuration="19.956888905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:39.909118297 +0000 UTC m=+5.645926715" watchObservedRunningTime="2026-09-07 17:08:55.956888905 +0000 UTC m=+21.693697316"
Sep 07 17:08:55.998505 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:55.998444    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ww7jf" podStartSLOduration=10.414560299 podStartE2EDuration="20.998429997s" totalImagesPullingTime="10.583869698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:55.997786607 +0000 UTC m=+21.734595015" watchObservedRunningTime="2026-09-07 17:08:55.998429997 +0000 UTC m=+21.735238424"
Sep 07 17:08:56.042607 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.042566    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tnsjj" podStartSLOduration=3.245612078 podStartE2EDuration="21.042550058s" totalImagesPullingTime="17.79693798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:56.02218524 +0000 UTC m=+21.758993652" watchObservedRunningTime="2026-09-07 17:08:56.042550058 +0000 UTC m=+21.779358470"
Sep 07 17:08:56.066224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.066179    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wjhtl" podStartSLOduration=3.202019601 podStartE2EDuration="21.066165212s" totalImagesPullingTime="17.864145611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:56.042102369 +0000 UTC m=+21.778910792" watchObservedRunningTime="2026-09-07 17:08:56.066165212 +0000 UTC m=+21.802973624"
Sep 07 17:08:56.066386 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.066361    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-28qbv" podStartSLOduration=3.272831971 podStartE2EDuration="21.066351528s" totalImagesPullingTime="17.793519557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:56.065770833 +0000 UTC m=+21.802579244" watchObservedRunningTime="2026-09-07 17:08:56.066351528 +0000 UTC m=+21.803159943"
Sep 07 17:08:56.767063 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.766827    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:56.767304 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.766875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:56.767304 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:56.767201    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:56.767304 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:56.767254    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:56.953773 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.953707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"6bffaea0c06310a17bbcb1b01b2f1dc33313b34f7bd9eb80d29e65c9125bdd37"}
Sep 07 17:08:56.954927 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.953825    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"ce0a591eef5834c37b828435ef5e36ef1dafff76a485d988aa8b5bd87ef6bbb0"}
Sep 07 17:08:56.954927 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.953859    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"d24706101c904ca896ff4f25fb23f021e20aef28247d7bd2fc881e1af2261028"}
Sep 07 17:08:56.954927 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:56.953899    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"3c97cc10ea3a92129798ae3a0a7511af0df8d1cfa2f0fc1120846f0d26934cf5"}
Sep 07 17:08:57.155503 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.155479    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 17:08:57.750473 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.750359    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T17:08:57.155497241Z","UUID":"487be22c-b7f9-494a-832c-f1f5e869e6da","Handler":null,"Name":"","Endpoint":""}
Sep 07 17:08:57.752246 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.752173    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 17:08:57.752246 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.752210    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 17:08:57.766889 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.766861    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:57.767023 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:57.766980    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:08:57.959114 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.959076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t" event={"ID":"570cf421-60b5-465e-b96b-53bead8eae68","Type":"ContainerStarted","Data":"cf5a1cb5a5c6dece0395ea6307036cd065cf33af983b3a84006cfa87fda40677"}
Sep 07 17:08:57.961008 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:57.960944    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hs8fc" event={"ID":"22ce17bd-3a00-409e-8faf-06c0e0568ba5","Type":"ContainerStarted","Data":"c1d904f51d89455de9363e8998f396352034b3e43b554716aee3fadf27d0d21f"}
Sep 07 17:08:58.766781 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:58.766744    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:08:58.766975 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:58.766889    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:08:58.766975 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:58.766940    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:08:58.767104 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:58.767041    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:08:58.967085 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:58.967047    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"197dfe8e48717495c73d02d586eccc621abbc2752818d3d9aadefa5545c33874"}
Sep 07 17:08:58.969466 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:58.969438    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t" event={"ID":"570cf421-60b5-465e-b96b-53bead8eae68","Type":"ContainerStarted","Data":"65b1d44623aac9d0a8d8ceea4db7d800f98f627ee393379dda49e67faca434fa"}
Sep 07 17:08:58.992523 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:58.992471    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hs8fc" podStartSLOduration=6.189950148 podStartE2EDuration="23.99245171s" totalImagesPullingTime="17.802501562s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:57.978036829 +0000 UTC m=+23.714845246" watchObservedRunningTime="2026-09-07 17:08:58.99245171 +0000 UTC m=+24.729260125"
Sep 07 17:08:59.766660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:08:59.766627    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:08:59.766830 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:08:59.766779    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:09:00.708382 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.708156    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:09:00.708992 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.708697    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:09:00.724583 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.724544    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zh29t" podStartSLOduration=5.642399423 podStartE2EDuration="25.724531176s" totalImagesPullingTime="20.082131753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:08:58.993377391 +0000 UTC m=+24.730185804" watchObservedRunningTime="2026-09-07 17:09:00.724531176 +0000 UTC m=+26.461339585"
Sep 07 17:09:00.767160 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.767128    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:00.767271 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.767170    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:00.767271 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:00.767234    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:09:00.767368 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:00.767350    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:09:00.977570 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.977495    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" event={"ID":"67260cc8-cddb-49f8-beda-24d582982b53","Type":"ContainerStarted","Data":"d93388073c0737d49a531e46d98a69720df77cf95f60f75d17e1a7de5ee3c8cf"}
Sep 07 17:09:00.977765 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.977693    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:09:00.979404 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.979361    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e4de1cd-2af1-4d98-be48-9713f59c41d6" containerID="2c4fe8c66a2fed1d238a42871820d86b47b88718b96f841e8d9a19a24435440a" exitCode=0
Sep 07 17:09:00.979404 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.979391    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerDied","Data":"2c4fe8c66a2fed1d238a42871820d86b47b88718b96f841e8d9a19a24435440a"}
Sep 07 17:09:00.979615 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.979595    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:09:00.980133 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.980044    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ww7jf"
Sep 07 17:09:00.992879 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:00.992862    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:09:01.007002 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:01.006965    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn" podStartSLOduration=8.14071237 podStartE2EDuration="26.006952416s" totalImagesPullingTime="17.866240046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:01.006404693 +0000 UTC m=+26.743213131" watchObservedRunningTime="2026-09-07 17:09:01.006952416 +0000 UTC m=+26.743760828"
Sep 07 17:09:01.766185 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:01.766153    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:01.766808 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:01.766277    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:09:01.981236 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:01.981207    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 17:09:01.981460 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:01.981434    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:09:01.995597 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:01.995572    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:09:02.435487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.435234    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ktvgz"]
Sep 07 17:09:02.435654 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.435491    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:02.435654 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:02.435578    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:09:02.437437 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.437410    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wvtk"]
Sep 07 17:09:02.437560 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.437500    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:02.437632 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:02.437598    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:09:02.437989 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.437970    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84kp7"]
Sep 07 17:09:02.438068 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.438057    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:02.438151 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:02.438136    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:09:02.985638 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.985604    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e4de1cd-2af1-4d98-be48-9713f59c41d6" containerID="9b3c52510ffe061cf555f0a914faca39736cf11c24958a554edf66977a4672bb" exitCode=0
Sep 07 17:09:02.986119 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.985671    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerDied","Data":"9b3c52510ffe061cf555f0a914faca39736cf11c24958a554edf66977a4672bb"}
Sep 07 17:09:02.986185 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:02.986138    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 17:09:03.766671 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:03.766642    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:03.766862 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:03.766727    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:03.766862 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:03.766856    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:03.766962 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:03.766888    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:09:03.767011 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:03.766965    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:09:03.767087 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:03.767060    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:09:03.991099 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:03.991070    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 07 17:09:04.109092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:04.109025    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:09:04.996422 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:04.996393    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e4de1cd-2af1-4d98-be48-9713f59c41d6" containerID="776d8253dab8fb21cd80b19a826c2b5c807b9b031d3c58129f789dcccd95961e" exitCode=0
Sep 07 17:09:04.996786 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:04.996476    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerDied","Data":"776d8253dab8fb21cd80b19a826c2b5c807b9b031d3c58129f789dcccd95961e"}
Sep 07 17:09:05.766587 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:05.766388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:05.766786 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:05.766388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:05.766786 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:05.766389    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:05.766786 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:05.766700    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:09:05.766967 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:05.766815    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:09:05.766967 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:05.766890    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:09:07.767127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:07.767089    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:07.767594 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:07.767209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:07.767594 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:07.767219    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktvgz" podUID="604b5a48-4e6e-4f47-8d12-58f6eb58e9a2"
Sep 07 17:09:07.767594 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:07.767242    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:07.767594 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:07.767326    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84kp7" podUID="2736a459-1c6a-4d22-88da-e56f248f4c09"
Sep 07 17:09:07.767594 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:07.767397    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7wvtk" podUID="5328ca9e-8642-4e59-a6fe-16f32fcc3c02"
Sep 07 17:09:08.527225 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.527186    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:08.527387 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.527288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:08.527387 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.527345    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:09:08.527471 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.527391    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 17:09:08.527471 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.527424    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs podName:2736a459-1c6a-4d22-88da-e56f248f4c09 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:40.5274044 +0000 UTC m=+66.264212790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs") pod "network-metrics-daemon-84kp7" (UID: "2736a459-1c6a-4d22-88da-e56f248f4c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 17:09:08.527471 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.527443    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret podName:5328ca9e-8642-4e59-a6fe-16f32fcc3c02 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:40.527436064 +0000 UTC m=+66.264244453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret") pod "global-pull-secret-syncer-7wvtk" (UID: "5328ca9e-8642-4e59-a6fe-16f32fcc3c02") : object "kube-system"/"original-pull-secret" not registered
Sep 07 17:09:08.571397 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.571363    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeReady"
Sep 07 17:09:08.571547 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.571508    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 17:09:08.619309 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.619274    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lbn8b"]
Sep 07 17:09:08.622225 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.622193    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.622471 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.622352    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tdvlb"]
Sep 07 17:09:08.624743 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.624708    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 17:09:08.624856 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.624717    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 17:09:08.625099 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.625077    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq2rt\""
Sep 07 17:09:08.625194 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.625101    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.627916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.627892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:08.628040 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.628013    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 17:09:08.628040 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.628033    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 17:09:08.628173 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.628046    2566 projected.go:196] Error preparing data for projected volume kube-api-access-5xjmj for pod openshift-network-diagnostics/network-check-target-ktvgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:09:08.628173 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.628054    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 17:09:08.628173 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.628099    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj podName:604b5a48-4e6e-4f47-8d12-58f6eb58e9a2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:40.628081858 +0000 UTC m=+66.364890252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5xjmj" (UniqueName: "kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj") pod "network-check-target-ktvgz" (UID: "604b5a48-4e6e-4f47-8d12-58f6eb58e9a2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 17:09:08.628173 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.628102    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 17:09:08.628173 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.628128    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5zx9s\""
Sep 07 17:09:08.628476 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.628455    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 17:09:08.632005 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.631982    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lbn8b"]
Sep 07 17:09:08.634800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.634749    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tdvlb"]
Sep 07 17:09:08.728998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.728902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e548326-1231-4411-b8a2-31eb5f78f97f-tmp-dir\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.728998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.728958    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.729217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.729036    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e548326-1231-4411-b8a2-31eb5f78f97f-config-volume\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.729217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.729073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfw2\" (UniqueName: \"kubernetes.io/projected/9e548326-1231-4411-b8a2-31eb5f78f97f-kube-api-access-djfw2\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.729217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.729109    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qzw5\" (UniqueName: \"kubernetes.io/projected/a223c599-943b-426d-8a68-f22abe23b63b-kube-api-access-8qzw5\") pod \"ingress-canary-tdvlb\" (UID: \"a223c599-943b-426d-8a68-f22abe23b63b\") " pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.729217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.729136    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a223c599-943b-426d-8a68-f22abe23b63b-cert\") pod \"ingress-canary-tdvlb\" (UID: \"a223c599-943b-426d-8a68-f22abe23b63b\") " pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.829550 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829505    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e548326-1231-4411-b8a2-31eb5f78f97f-tmp-dir\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.829550 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.829635    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e548326-1231-4411-b8a2-31eb5f78f97f-config-volume\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:08.829700    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls podName:9e548326-1231-4411-b8a2-31eb5f78f97f nodeName:}" failed. No retries permitted until 2026-09-07 17:09:09.329673206 +0000 UTC m=+35.066481615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls") pod "dns-default-lbn8b" (UID: "9e548326-1231-4411-b8a2-31eb5f78f97f") : secret "dns-default-metrics-tls" not found
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829749    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfw2\" (UniqueName: \"kubernetes.io/projected/9e548326-1231-4411-b8a2-31eb5f78f97f-kube-api-access-djfw2\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829788    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qzw5\" (UniqueName: \"kubernetes.io/projected/a223c599-943b-426d-8a68-f22abe23b63b-kube-api-access-8qzw5\") pod \"ingress-canary-tdvlb\" (UID: \"a223c599-943b-426d-8a68-f22abe23b63b\") " pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829819    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a223c599-943b-426d-8a68-f22abe23b63b-cert\") pod \"ingress-canary-tdvlb\" (UID: \"a223c599-943b-426d-8a68-f22abe23b63b\") " pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.829998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.829844    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e548326-1231-4411-b8a2-31eb5f78f97f-tmp-dir\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.830591 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.830544    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9e548326-1231-4411-b8a2-31eb5f78f97f-config-volume\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.834020 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.833999    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a223c599-943b-426d-8a68-f22abe23b63b-cert\") pod \"ingress-canary-tdvlb\" (UID: \"a223c599-943b-426d-8a68-f22abe23b63b\") " pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.840135 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.839360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfw2\" (UniqueName: \"kubernetes.io/projected/9e548326-1231-4411-b8a2-31eb5f78f97f-kube-api-access-djfw2\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:08.840135 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.839658    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qzw5\" (UniqueName: \"kubernetes.io/projected/a223c599-943b-426d-8a68-f22abe23b63b-kube-api-access-8qzw5\") pod \"ingress-canary-tdvlb\" (UID: \"a223c599-943b-426d-8a68-f22abe23b63b\") " pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:08.941485 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:08.941449    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tdvlb"
Sep 07 17:09:09.010880 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.010647    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e4de1cd-2af1-4d98-be48-9713f59c41d6" containerID="a2c2c35ead630e0b42f6deed0ab1649984c56720cf513d69ff01edb593e31b4d" exitCode=0
Sep 07 17:09:09.010880 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.010727    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerDied","Data":"a2c2c35ead630e0b42f6deed0ab1649984c56720cf513d69ff01edb593e31b4d"}
Sep 07 17:09:09.221054 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.221026    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tdvlb"]
Sep 07 17:09:09.224149 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:09.224120    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda223c599_943b_426d_8a68_f22abe23b63b.slice/crio-8a0b0850c6433127d51e6df4f21f728fbcb51dc16002ab6460aef0953f0bfbd6 WatchSource:0}: Error finding container 8a0b0850c6433127d51e6df4f21f728fbcb51dc16002ab6460aef0953f0bfbd6: Status 404 returned error can't find the container with id 8a0b0850c6433127d51e6df4f21f728fbcb51dc16002ab6460aef0953f0bfbd6
Sep 07 17:09:09.333441 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.333407    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:09.333585 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:09.333530    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 17:09:09.333622 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:09.333585    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls podName:9e548326-1231-4411-b8a2-31eb5f78f97f nodeName:}" failed. No retries permitted until 2026-09-07 17:09:10.333570517 +0000 UTC m=+36.070378924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls") pod "dns-default-lbn8b" (UID: "9e548326-1231-4411-b8a2-31eb5f78f97f") : secret "dns-default-metrics-tls" not found
Sep 07 17:09:09.766620 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.766587    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:09.766828 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.766708    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:09.766828 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.766759    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:09.769810 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.769629    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 17:09:09.769810 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.769669    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 17:09:09.769810 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.769692    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 17:09:09.770863 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.770831    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xmgvk\""
Sep 07 17:09:09.770966 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.770876    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 17:09:09.770966 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:09.770928    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwmqq\""
Sep 07 17:09:10.017674 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:10.017589    2566 generic.go:356] "Generic (PLEG): container finished" podID="2e4de1cd-2af1-4d98-be48-9713f59c41d6" containerID="54a1b2fbe8617306e77dc25b172ac03604b0947a153f01a364d92c6cc8d1101a" exitCode=0
Sep 07 17:09:10.018504 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:10.017670    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerDied","Data":"54a1b2fbe8617306e77dc25b172ac03604b0947a153f01a364d92c6cc8d1101a"}
Sep 07 17:09:10.019394 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:10.019290    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tdvlb" event={"ID":"a223c599-943b-426d-8a68-f22abe23b63b","Type":"ContainerStarted","Data":"8a0b0850c6433127d51e6df4f21f728fbcb51dc16002ab6460aef0953f0bfbd6"}
Sep 07 17:09:10.340759 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:10.340667    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:10.340907 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:10.340822    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 17:09:10.340907 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:10.340904    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls podName:9e548326-1231-4411-b8a2-31eb5f78f97f nodeName:}" failed. No retries permitted until 2026-09-07 17:09:12.340882458 +0000 UTC m=+38.077690868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls") pod "dns-default-lbn8b" (UID: "9e548326-1231-4411-b8a2-31eb5f78f97f") : secret "dns-default-metrics-tls" not found
Sep 07 17:09:11.026089 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:11.026057    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" event={"ID":"2e4de1cd-2af1-4d98-be48-9713f59c41d6","Type":"ContainerStarted","Data":"18b3129803f564f5b20380345386ec331fd0c2815d7be658e85896fd2e706117"}
Sep 07 17:09:11.052192 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:11.052141    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sgvmz" podStartSLOduration=7.887793404 podStartE2EDuration="36.052120177s" totalImagesPullingTime="28.164326773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:11.050807506 +0000 UTC m=+36.787615917" watchObservedRunningTime="2026-09-07 17:09:11.052120177 +0000 UTC m=+36.788928570"
Sep 07 17:09:12.029524 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:12.029480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tdvlb" event={"ID":"a223c599-943b-426d-8a68-f22abe23b63b","Type":"ContainerStarted","Data":"6a1e9b957fcbb431b1c83b9207f2a10bd83d60735b06c1fff0481cfaec8e138e"}
Sep 07 17:09:12.046523 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:12.046479    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tdvlb" podStartSLOduration=1.717675779 podStartE2EDuration="4.046465184s" totalImagesPullingTime="2.328789405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:12.046419741 +0000 UTC m=+37.783228153" watchObservedRunningTime="2026-09-07 17:09:12.046465184 +0000 UTC m=+37.783273590"
Sep 07 17:09:12.355424 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:12.355337    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:12.355562 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:12.355467    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 17:09:12.355562 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:12.355525    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls podName:9e548326-1231-4411-b8a2-31eb5f78f97f nodeName:}" failed. No retries permitted until 2026-09-07 17:09:16.355511935 +0000 UTC m=+42.092320325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls") pod "dns-default-lbn8b" (UID: "9e548326-1231-4411-b8a2-31eb5f78f97f") : secret "dns-default-metrics-tls" not found
Sep 07 17:09:16.382218 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:16.382039    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:16.382691 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:16.382188    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 17:09:16.382691 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:16.382292    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls podName:9e548326-1231-4411-b8a2-31eb5f78f97f nodeName:}" failed. No retries permitted until 2026-09-07 17:09:24.382273798 +0000 UTC m=+50.119082188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls") pod "dns-default-lbn8b" (UID: "9e548326-1231-4411-b8a2-31eb5f78f97f") : secret "dns-default-metrics-tls" not found
Sep 07 17:09:22.947438 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.947400    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7ff96"]
Sep 07 17:09:22.986645 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.986604    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7ff96"]
Sep 07 17:09:22.986845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.986766    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:22.989834 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.989806    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 17:09:22.989976 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.989892    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 17:09:22.989976 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.989935    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 17:09:22.993940 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.991300    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vzbr9\""
Sep 07 17:09:22.993940 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:22.991395    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 17:09:23.025663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.025636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-data-volume\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.025782 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.025679    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.025782 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.025766    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.025864 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.025784    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-crio-socket\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.025864 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.025801    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6p4\" (UniqueName: \"kubernetes.io/projected/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-api-access-xs6p4\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126567 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.126539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.126604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.126622    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-crio-socket\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.126639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6p4\" (UniqueName: \"kubernetes.io/projected/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-api-access-xs6p4\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.126662    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-data-volume\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126724 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.126716    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:23.126988 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.126800    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 17:09:23.126988 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.126812    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:23.626789538 +0000 UTC m=+49.363597934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:23.126988 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.126840    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-crio-socket\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.126988 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.126878    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:23.626859618 +0000 UTC m=+49.363668028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : configmap "kube-rbac-proxy" not found
Sep 07 17:09:23.127135 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.127018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-data-volume\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.136997 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.136969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6p4\" (UniqueName: \"kubernetes.io/projected/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-api-access-xs6p4\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.262376 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.262302    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"]
Sep 07 17:09:23.283978 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.283951    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"]
Sep 07 17:09:23.284100 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.284048    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"
Sep 07 17:09:23.287553 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.287530    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 07 17:09:23.287663 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.287605    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-drl6m\""
Sep 07 17:09:23.287977 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.287961    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 07 17:09:23.327411 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.327385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9q6x\" (UniqueName: \"kubernetes.io/projected/8effc74a-e4e8-4d3f-92ce-8ac6dbae7486-kube-api-access-c9q6x\") pod \"migrator-fdbb8fdff-5vzsq\" (UID: \"8effc74a-e4e8-4d3f-92ce-8ac6dbae7486\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"
Sep 07 17:09:23.428354 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.428325    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9q6x\" (UniqueName: \"kubernetes.io/projected/8effc74a-e4e8-4d3f-92ce-8ac6dbae7486-kube-api-access-c9q6x\") pod \"migrator-fdbb8fdff-5vzsq\" (UID: \"8effc74a-e4e8-4d3f-92ce-8ac6dbae7486\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"
Sep 07 17:09:23.438001 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.437975    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9q6x\" (UniqueName: \"kubernetes.io/projected/8effc74a-e4e8-4d3f-92ce-8ac6dbae7486-kube-api-access-c9q6x\") pod \"migrator-fdbb8fdff-5vzsq\" (UID: \"8effc74a-e4e8-4d3f-92ce-8ac6dbae7486\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"
Sep 07 17:09:23.592325 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.592296    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"
Sep 07 17:09:23.630160 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.630129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.630303 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.630202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:23.630303 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.630243    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:23.630303 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.630272    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 17:09:23.630466 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.630324    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:24.630305667 +0000 UTC m=+50.367114080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:23.630466 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:23.630349    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:24.630337134 +0000 UTC m=+50.367145523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : configmap "kube-rbac-proxy" not found
Sep 07 17:09:23.878019 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:23.877934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq"]
Sep 07 17:09:23.882036 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:23.882010    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8effc74a_e4e8_4d3f_92ce_8ac6dbae7486.slice/crio-ed0e88d0f410805fcdcb21216eaa7ae25c970c1bfab9327017c310e0610fa03b WatchSource:0}: Error finding container ed0e88d0f410805fcdcb21216eaa7ae25c970c1bfab9327017c310e0610fa03b: Status 404 returned error can't find the container with id ed0e88d0f410805fcdcb21216eaa7ae25c970c1bfab9327017c310e0610fa03b
Sep 07 17:09:24.060251 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:24.060218    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq" event={"ID":"8effc74a-e4e8-4d3f-92ce-8ac6dbae7486","Type":"ContainerStarted","Data":"ed0e88d0f410805fcdcb21216eaa7ae25c970c1bfab9327017c310e0610fa03b"}
Sep 07 17:09:24.435274 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:24.435239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:24.435472 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:24.435396    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 17:09:24.435472 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:24.435467    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls podName:9e548326-1231-4411-b8a2-31eb5f78f97f nodeName:}" failed. No retries permitted until 2026-09-07 17:09:40.435445854 +0000 UTC m=+66.172254248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls") pod "dns-default-lbn8b" (UID: "9e548326-1231-4411-b8a2-31eb5f78f97f") : secret "dns-default-metrics-tls" not found
Sep 07 17:09:24.637044 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:24.637006    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:24.637193 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:24.637065    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:24.637193 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:24.637130    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 17:09:24.637193 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:24.637166    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:24.637288 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:24.637206    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:26.637189244 +0000 UTC m=+52.373997633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : configmap "kube-rbac-proxy" not found
Sep 07 17:09:24.637288 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:24.637222    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:26.637215603 +0000 UTC m=+52.374023993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:24.698022 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:24.697963    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28qbv_e45a50fa-ca6f-4298-9807-9964c6ae62a3/dns-node-resolver/0.log"
Sep 07 17:09:26.066781 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.066725    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq" event={"ID":"8effc74a-e4e8-4d3f-92ce-8ac6dbae7486","Type":"ContainerStarted","Data":"d21574b3392d06cd67ac975ce0b1e7f466b099ed52d19e6ab7097e73eb077ef0"}
Sep 07 17:09:26.067128 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.066842    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq" event={"ID":"8effc74a-e4e8-4d3f-92ce-8ac6dbae7486","Type":"ContainerStarted","Data":"6cae49965e298815526c467c44dafaf838f5a3a0419bedbd078272e97a5b9031"}
Sep 07 17:09:26.087824 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.087775    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-5vzsq" podStartSLOduration=1.6430462540000002 podStartE2EDuration="3.087760629s" totalImagesPullingTime="1.444714375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:26.086216822 +0000 UTC m=+51.823025234" watchObservedRunningTime="2026-09-07 17:09:26.087760629 +0000 UTC m=+51.824569032"
Sep 07 17:09:26.098794 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.098770    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tnsjj_4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d/node-ca/0.log"
Sep 07 17:09:26.655691 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.655658    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:26.655901 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.655726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:26.655901 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:26.655811    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 17:09:26.655901 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:26.655831    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:26.655901 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:26.655888    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:30.655870463 +0000 UTC m=+56.392678868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : configmap "kube-rbac-proxy" not found
Sep 07 17:09:26.655901 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:26.655902    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:30.65589691 +0000 UTC m=+56.392705300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:26.903392 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:26.903338    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdvlb_a223c599-943b-426d-8a68-f22abe23b63b/serve-healthcheck-canary/0.log"
Sep 07 17:09:30.684467 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:30.684429    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:30.684947 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:30.684501    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:30.684947 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:30.684569    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 17:09:30.684947 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:30.684582    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:30.684947 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:30.684623    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:38.684609152 +0000 UTC m=+64.421417542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : configmap "kube-rbac-proxy" not found
Sep 07 17:09:30.684947 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:30.684648    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:38.684634466 +0000 UTC m=+64.421442855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:35.006630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:35.006595    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q5vrn"
Sep 07 17:09:38.754011 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:38.753963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:38.754478 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:38.754052    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:38.754478 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:38.754105    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:38.754478 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:09:38.754181    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls podName:6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2 nodeName:}" failed. No retries permitted until 2026-09-07 17:09:54.754165604 +0000 UTC m=+80.490974000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7ff96" (UID: "6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2") : secret "insights-runtime-extractor-tls" not found
Sep 07 17:09:38.754592 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:38.754525    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:40.465812 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.465770    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:40.468100 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.468078    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e548326-1231-4411-b8a2-31eb5f78f97f-metrics-tls\") pod \"dns-default-lbn8b\" (UID: \"9e548326-1231-4411-b8a2-31eb5f78f97f\") " pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:40.566307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.566275    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:40.566307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.566312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:40.569082 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.569061    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 17:09:40.570181 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.570165    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 17:09:40.579525 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.579498    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5328ca9e-8642-4e59-a6fe-16f32fcc3c02-original-pull-secret\") pod \"global-pull-secret-syncer-7wvtk\" (UID: \"5328ca9e-8642-4e59-a6fe-16f32fcc3c02\") " pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:40.579624 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.579526    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2736a459-1c6a-4d22-88da-e56f248f4c09-metrics-certs\") pod \"network-metrics-daemon-84kp7\" (UID: \"2736a459-1c6a-4d22-88da-e56f248f4c09\") " pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:40.667060 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.667028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:40.670599 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.670579    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 17:09:40.679473 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.679450    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7wvtk"
Sep 07 17:09:40.680047 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.680029    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 17:09:40.687721 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.687702    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xmgvk\""
Sep 07 17:09:40.689669 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.689649    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjmj\" (UniqueName: \"kubernetes.io/projected/604b5a48-4e6e-4f47-8d12-58f6eb58e9a2-kube-api-access-5xjmj\") pod \"network-check-target-ktvgz\" (UID: \"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2\") " pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:40.695332 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.695314    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84kp7"
Sep 07 17:09:40.695409 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.695344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwmqq\""
Sep 07 17:09:40.702693 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.702679    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:40.738805 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.738769    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wq2rt\""
Sep 07 17:09:40.746188 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.746166    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:40.980159 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:40.979897    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7wvtk"]
Sep 07 17:09:40.987100 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:40.987068    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5328ca9e_8642_4e59_a6fe_16f32fcc3c02.slice/crio-2d61724827c7f5953b3748d1a1cae0af290bfcf0ee547ad4dbfcd1ef7da55679 WatchSource:0}: Error finding container 2d61724827c7f5953b3748d1a1cae0af290bfcf0ee547ad4dbfcd1ef7da55679: Status 404 returned error can't find the container with id 2d61724827c7f5953b3748d1a1cae0af290bfcf0ee547ad4dbfcd1ef7da55679
Sep 07 17:09:41.013404 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.013370    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84kp7"]
Sep 07 17:09:41.015619 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:41.015595    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2736a459_1c6a_4d22_88da_e56f248f4c09.slice/crio-eed3991dd711b8df03f2bfccd6b0ffe9103fabfce8f5f959ab9a612aaeb89618 WatchSource:0}: Error finding container eed3991dd711b8df03f2bfccd6b0ffe9103fabfce8f5f959ab9a612aaeb89618: Status 404 returned error can't find the container with id eed3991dd711b8df03f2bfccd6b0ffe9103fabfce8f5f959ab9a612aaeb89618
Sep 07 17:09:41.037964 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.037940    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ktvgz"]
Sep 07 17:09:41.040766 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:41.040724    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604b5a48_4e6e_4f47_8d12_58f6eb58e9a2.slice/crio-3bf9583d4e3e6e4c54829f083bc0abb875a622f84b49f751b8dd61b4d33eb1fa WatchSource:0}: Error finding container 3bf9583d4e3e6e4c54829f083bc0abb875a622f84b49f751b8dd61b4d33eb1fa: Status 404 returned error can't find the container with id 3bf9583d4e3e6e4c54829f083bc0abb875a622f84b49f751b8dd61b4d33eb1fa
Sep 07 17:09:41.067891 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.067866    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lbn8b"]
Sep 07 17:09:41.070090 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:41.070067    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e548326_1231_4411_b8a2_31eb5f78f97f.slice/crio-fb6b489b4a5919cf6779535d4b8066c17f99cebfc09caa123fc6310a2259b180 WatchSource:0}: Error finding container fb6b489b4a5919cf6779535d4b8066c17f99cebfc09caa123fc6310a2259b180: Status 404 returned error can't find the container with id fb6b489b4a5919cf6779535d4b8066c17f99cebfc09caa123fc6310a2259b180
Sep 07 17:09:41.103557 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.103530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbn8b" event={"ID":"9e548326-1231-4411-b8a2-31eb5f78f97f","Type":"ContainerStarted","Data":"fb6b489b4a5919cf6779535d4b8066c17f99cebfc09caa123fc6310a2259b180"}
Sep 07 17:09:41.104683 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.104661    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ktvgz" event={"ID":"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2","Type":"ContainerStarted","Data":"3bf9583d4e3e6e4c54829f083bc0abb875a622f84b49f751b8dd61b4d33eb1fa"}
Sep 07 17:09:41.105801 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.105774    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84kp7" event={"ID":"2736a459-1c6a-4d22-88da-e56f248f4c09","Type":"ContainerStarted","Data":"eed3991dd711b8df03f2bfccd6b0ffe9103fabfce8f5f959ab9a612aaeb89618"}
Sep 07 17:09:41.106853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:41.106836    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wvtk" event={"ID":"5328ca9e-8642-4e59-a6fe-16f32fcc3c02","Type":"ContainerStarted","Data":"2d61724827c7f5953b3748d1a1cae0af290bfcf0ee547ad4dbfcd1ef7da55679"}
Sep 07 17:09:44.118458 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:44.118396    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84kp7" event={"ID":"2736a459-1c6a-4d22-88da-e56f248f4c09","Type":"ContainerStarted","Data":"8489e873d12a93c5c1c59a33e373a66a73633241f05b28bccb95e8eaf1a27a4c"}
Sep 07 17:09:44.120011 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:44.119983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbn8b" event={"ID":"9e548326-1231-4411-b8a2-31eb5f78f97f","Type":"ContainerStarted","Data":"5145dbf501ee79bab889259e7866600b7d7d404bb9dc77a820ea9eb81e3a145c"}
Sep 07 17:09:46.127278 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.127244    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lbn8b" event={"ID":"9e548326-1231-4411-b8a2-31eb5f78f97f","Type":"ContainerStarted","Data":"6663e333a7990918754a6744d5dd03b749e00f537c86a2370a64aad7930b94df"}
Sep 07 17:09:46.127761 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.127358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:46.128846 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.128816    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ktvgz" event={"ID":"604b5a48-4e6e-4f47-8d12-58f6eb58e9a2","Type":"ContainerStarted","Data":"d4fd0809d5db131e81ff265d8347fb8cfbafed306b74519ac0cb7da3c48bf77a"}
Sep 07 17:09:46.128963 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.128947    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:09:46.130549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.130523    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84kp7" event={"ID":"2736a459-1c6a-4d22-88da-e56f248f4c09","Type":"ContainerStarted","Data":"a66260d7ce5c46193609687d1b7f6de0c7736f1372721c573b828aab822e18ce"}
Sep 07 17:09:46.131859 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.131837    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7wvtk" event={"ID":"5328ca9e-8642-4e59-a6fe-16f32fcc3c02","Type":"ContainerStarted","Data":"54971a1c0587061b0c2d3719f62942335978d5ce02d7109622520ba286ca4a9f"}
Sep 07 17:09:46.158404 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.158358    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lbn8b" podStartSLOduration=35.976628877 podStartE2EDuration="38.15834687s" totalImagesPullingTime="2.181717993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:46.15634042 +0000 UTC m=+71.893148832" watchObservedRunningTime="2026-09-07 17:09:46.15834687 +0000 UTC m=+71.895155282"
Sep 07 17:09:46.178830 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.178792    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-84kp7" podStartSLOduration=68.971178434 podStartE2EDuration="1m11.178781079s" totalImagesPullingTime="2.207602645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:46.178482512 +0000 UTC m=+71.915290923" watchObservedRunningTime="2026-09-07 17:09:46.178781079 +0000 UTC m=+71.915589490"
Sep 07 17:09:46.202198 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.202161    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7wvtk" podStartSLOduration=66.456060323 podStartE2EDuration="1m11.202148658s" totalImagesPullingTime="4.746088335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:46.201453915 +0000 UTC m=+71.938262327" watchObservedRunningTime="2026-09-07 17:09:46.202148658 +0000 UTC m=+71.938957070"
Sep 07 17:09:46.219463 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:46.219428    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ktvgz" podStartSLOduration=66.539534954 podStartE2EDuration="1m11.219417051s" totalImagesPullingTime="4.679882097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:46.219058003 +0000 UTC m=+71.955866417" watchObservedRunningTime="2026-09-07 17:09:46.219417051 +0000 UTC m=+71.956225463"
Sep 07 17:09:52.616480 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.616443    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-cnbd7"]
Sep 07 17:09:52.618859 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.618838    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:09:52.629135 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.629113    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 17:09:52.629242 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.629120    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 17:09:52.629367 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.629354    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5jhz7\""
Sep 07 17:09:52.671876 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.671849    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-cnbd7"]
Sep 07 17:09:52.751360 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.751327    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkmf2\" (UniqueName: \"kubernetes.io/projected/287dea2b-f601-4b31-986e-2ee578804616-kube-api-access-hkmf2\") pod \"downloads-85d98c998f-cnbd7\" (UID: \"287dea2b-f601-4b31-986e-2ee578804616\") " pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:09:52.770276 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.770252    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78bfb96ddb-2cnl4"]
Sep 07 17:09:52.772128 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.772114    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.777174 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.777154    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 17:09:52.781585 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.778258    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cxf5h\""
Sep 07 17:09:52.782127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.782094    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 17:09:52.783065 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.783047    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 17:09:52.788911 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.788894    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 17:09:52.792126 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.792106    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bfb96ddb-2cnl4"]
Sep 07 17:09:52.852463 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852430    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-registry-certificates\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852601 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852469    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkmf2\" (UniqueName: \"kubernetes.io/projected/287dea2b-f601-4b31-986e-2ee578804616-kube-api-access-hkmf2\") pod \"downloads-85d98c998f-cnbd7\" (UID: \"287dea2b-f601-4b31-986e-2ee578804616\") " pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:09:52.852601 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852494    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-ca-trust-extracted\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852664 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-image-registry-private-configuration\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852664 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852654    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-registry-tls\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852750 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852679    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-installation-pull-secrets\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852750 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852719    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-trusted-ca\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852816 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852762    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-bound-sa-token\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.852816 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.852788    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk92m\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-kube-api-access-tk92m\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.867120 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.867061    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkmf2\" (UniqueName: \"kubernetes.io/projected/287dea2b-f601-4b31-986e-2ee578804616-kube-api-access-hkmf2\") pod \"downloads-85d98c998f-cnbd7\" (UID: \"287dea2b-f601-4b31-986e-2ee578804616\") " pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:09:52.926789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.926754    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:09:52.954015 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.953980    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-image-registry-private-configuration\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954015 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954019    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-registry-tls\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-installation-pull-secrets\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-trusted-ca\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954077    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-bound-sa-token\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954093    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk92m\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-kube-api-access-tk92m\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-registry-certificates\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954483 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954289    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-ca-trust-extracted\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.954753 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.954709    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-ca-trust-extracted\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.955170 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.955149    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-trusted-ca\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.955264 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.955164    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-registry-certificates\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.956568 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.956544    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-image-registry-private-configuration\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.956794 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.956766    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-registry-tls\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.957084 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.957063    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-installation-pull-secrets\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.966691 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.966664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk92m\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-kube-api-access-tk92m\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:52.968147 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:52.968124    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d9fc8f-b31e-47f4-82da-57edd42e1e7b-bound-sa-token\") pod \"image-registry-78bfb96ddb-2cnl4\" (UID: \"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b\") " pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:53.081425 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:53.081386    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:53.137614 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:53.137592    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lbn8b"
Sep 07 17:09:53.223853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:53.223821    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-cnbd7"]
Sep 07 17:09:53.226442 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:53.226410    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287dea2b_f601_4b31_986e_2ee578804616.slice/crio-45351f3503b87b70d6c6ca50cb51ef03e1888f55b724901c2a58d9b0908c4b65 WatchSource:0}: Error finding container 45351f3503b87b70d6c6ca50cb51ef03e1888f55b724901c2a58d9b0908c4b65: Status 404 returned error can't find the container with id 45351f3503b87b70d6c6ca50cb51ef03e1888f55b724901c2a58d9b0908c4b65
Sep 07 17:09:53.351808 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:53.351779    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78bfb96ddb-2cnl4"]
Sep 07 17:09:53.356051 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:53.356021    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d9fc8f_b31e_47f4_82da_57edd42e1e7b.slice/crio-b33185972c5d85b3a3c29c71630b64014cbddfb11ef1357ce783e03dd8424707 WatchSource:0}: Error finding container b33185972c5d85b3a3c29c71630b64014cbddfb11ef1357ce783e03dd8424707: Status 404 returned error can't find the container with id b33185972c5d85b3a3c29c71630b64014cbddfb11ef1357ce783e03dd8424707
Sep 07 17:09:54.157851 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.157812    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4" event={"ID":"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b","Type":"ContainerStarted","Data":"fc7f27e2e1bd5678d4984c66195ce41e8059be69ea2061ecd704b0126070b8ba"}
Sep 07 17:09:54.158313 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.157877    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4" event={"ID":"e0d9fc8f-b31e-47f4-82da-57edd42e1e7b","Type":"ContainerStarted","Data":"b33185972c5d85b3a3c29c71630b64014cbddfb11ef1357ce783e03dd8424707"}
Sep 07 17:09:54.158313 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.157906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:09:54.159216 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.159146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-cnbd7" event={"ID":"287dea2b-f601-4b31-986e-2ee578804616","Type":"ContainerStarted","Data":"45351f3503b87b70d6c6ca50cb51ef03e1888f55b724901c2a58d9b0908c4b65"}
Sep 07 17:09:54.178866 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.178825    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4" podStartSLOduration=2.178805981 podStartE2EDuration="2.178805981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:54.178347035 +0000 UTC m=+79.915155449" watchObservedRunningTime="2026-09-07 17:09:54.178805981 +0000 UTC m=+79.915614394"
Sep 07 17:09:54.768058 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.768014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:54.770659 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.770631    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7ff96\" (UID: \"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2\") " pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:54.801248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.801225    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vzbr9\""
Sep 07 17:09:54.808647 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:54.808621    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7ff96"
Sep 07 17:09:55.090188 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:55.090153    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7ff96"]
Sep 07 17:09:55.093366 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:09:55.093324    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed84d6b_30f2_4bcc_9a99_cbbb0f43edc2.slice/crio-1686f149a8a6f6a25f3b04e65546ef9559653ccca7341cc94ca9ce3f6e0e5375 WatchSource:0}: Error finding container 1686f149a8a6f6a25f3b04e65546ef9559653ccca7341cc94ca9ce3f6e0e5375: Status 404 returned error can't find the container with id 1686f149a8a6f6a25f3b04e65546ef9559653ccca7341cc94ca9ce3f6e0e5375
Sep 07 17:09:55.166956 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:55.166927    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ff96" event={"ID":"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2","Type":"ContainerStarted","Data":"d6ee32b6c61414365f7c6a50572b9922821d7076739bd4d27df3923dcd2df637"}
Sep 07 17:09:55.167295 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:55.166985    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ff96" event={"ID":"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2","Type":"ContainerStarted","Data":"1686f149a8a6f6a25f3b04e65546ef9559653ccca7341cc94ca9ce3f6e0e5375"}
Sep 07 17:09:56.173345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:56.173302    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ff96" event={"ID":"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2","Type":"ContainerStarted","Data":"89a6668261ea91776e561b4a23525b2fc8c45eaed6202ad20eed2839ec7cab83"}
Sep 07 17:09:57.179471 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:57.179351    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7ff96" event={"ID":"6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2","Type":"ContainerStarted","Data":"a8f15a046debd0dc146057f22acf5ba772d4c91f7e6344760fc4e10532265900"}
Sep 07 17:09:57.209194 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:09:57.209126    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7ff96" podStartSLOduration=33.378284282 podStartE2EDuration="35.209101832s" totalImagesPullingTime="1.83081755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:09:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:09:57.208203068 +0000 UTC m=+82.945011482" watchObservedRunningTime="2026-09-07 17:09:57.209101832 +0000 UTC m=+82.945910245"
Sep 07 17:10:10.234158 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:10.234110    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-cnbd7" event={"ID":"287dea2b-f601-4b31-986e-2ee578804616","Type":"ContainerStarted","Data":"095f9f2a4fd2c4bf2bfa1e2590a18052e5446d23c02d03fe445c385e5fc69273"}
Sep 07 17:10:10.234697 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:10.234364    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:10:10.251812 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:10.251786    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-cnbd7"
Sep 07 17:10:10.258203 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:10.258157    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-cnbd7" podStartSLOduration=1.728516489 podStartE2EDuration="18.258144578s" totalImagesPullingTime="16.529628089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:10.256180641 +0000 UTC m=+95.992989058" watchObservedRunningTime="2026-09-07 17:10:10.258144578 +0000 UTC m=+95.994952991"
Sep 07 17:10:11.942722 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.942680    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6496748dfb-bwvvw"]
Sep 07 17:10:11.969610 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.969570    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6496748dfb-bwvvw"]
Sep 07 17:10:11.969789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.969705    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:11.972931 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.972898    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 17:10:11.973072 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.972898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 17:10:11.973187 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.972898    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 17:10:11.974179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.974160    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 17:10:11.974277 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.974194    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 17:10:11.974421 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:11.974406    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vmldm\""
Sep 07 17:10:12.096897 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.096856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-serving-cert\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.097093 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.096927    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpbqd\" (UniqueName: \"kubernetes.io/projected/348b2ab2-fb0b-45bf-aa1c-fefde9178500-kube-api-access-mpbqd\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.097093 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.096966    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-config\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.097093 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.097002    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-oauth-config\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.097093 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.097060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-service-ca\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.097285 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.097100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-oauth-serving-cert\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.198577 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.198486    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-serving-cert\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.198577 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.198544    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpbqd\" (UniqueName: \"kubernetes.io/projected/348b2ab2-fb0b-45bf-aa1c-fefde9178500-kube-api-access-mpbqd\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.198577 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.198572    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-config\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.198869 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.198604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-oauth-config\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.198869 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.198629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-service-ca\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.198869 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.198649    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-oauth-serving-cert\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.199551 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.199485    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-service-ca\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.199551 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.199491    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-config\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.200012 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.199985    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-oauth-serving-cert\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.201348 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.201328    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-serving-cert\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.201457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.201371    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-oauth-config\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.209462 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.209441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpbqd\" (UniqueName: \"kubernetes.io/projected/348b2ab2-fb0b-45bf-aa1c-fefde9178500-kube-api-access-mpbqd\") pod \"console-6496748dfb-bwvvw\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") " pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.280926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.280887    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:12.588695 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:12.588661    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6496748dfb-bwvvw"]
Sep 07 17:10:12.592047 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:10:12.592009    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348b2ab2_fb0b_45bf_aa1c_fefde9178500.slice/crio-45e6b4baf8289aa9087096ef956e5521eb1d379d02ac2636820bc3ad3ae64505 WatchSource:0}: Error finding container 45e6b4baf8289aa9087096ef956e5521eb1d379d02ac2636820bc3ad3ae64505: Status 404 returned error can't find the container with id 45e6b4baf8289aa9087096ef956e5521eb1d379d02ac2636820bc3ad3ae64505
Sep 07 17:10:13.248422 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:13.248381    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496748dfb-bwvvw" event={"ID":"348b2ab2-fb0b-45bf-aa1c-fefde9178500","Type":"ContainerStarted","Data":"45e6b4baf8289aa9087096ef956e5521eb1d379d02ac2636820bc3ad3ae64505"}
Sep 07 17:10:15.173275 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:15.173242    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78bfb96ddb-2cnl4"
Sep 07 17:10:16.263137 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:16.263085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496748dfb-bwvvw" event={"ID":"348b2ab2-fb0b-45bf-aa1c-fefde9178500","Type":"ContainerStarted","Data":"41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93"}
Sep 07 17:10:16.291988 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:16.291931    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6496748dfb-bwvvw" podStartSLOduration=1.825518521 podStartE2EDuration="5.291910722s" totalImagesPullingTime="3.466392201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:16.291576918 +0000 UTC m=+102.028385333" watchObservedRunningTime="2026-09-07 17:10:16.291910722 +0000 UTC m=+102.028719134"
Sep 07 17:10:17.138375 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:17.138343    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ktvgz"
Sep 07 17:10:20.144690 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.144655    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"]
Sep 07 17:10:20.181378 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.181349    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.184582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.184557    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-h4th9\""
Sep 07 17:10:20.185866 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.185837    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 07 17:10:20.186366 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.186347    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 07 17:10:20.186444 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.186369    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 17:10:20.186842 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.186821    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 17:10:20.186947 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.186843    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 17:10:20.211537 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.211513    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vwc7b"]
Sep 07 17:10:20.230965 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.230947    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"]
Sep 07 17:10:20.231070 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.231042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.234849 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.234825    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 17:10:20.234849 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.234836    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9xkvj\""
Sep 07 17:10:20.235457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.235439    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 17:10:20.235457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.235451    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 17:10:20.256602 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.256583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eccf25bc-6713-41ef-8e0c-478a980ca9eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.256715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.256610    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eccf25bc-6713-41ef-8e0c-478a980ca9eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.256715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.256634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eccf25bc-6713-41ef-8e0c-478a980ca9eb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.256715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.256672    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdmvj\" (UniqueName: \"kubernetes.io/projected/eccf25bc-6713-41ef-8e0c-478a980ca9eb-kube-api-access-pdmvj\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.357853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.357815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-wtmp\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358008 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.357863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eccf25bc-6713-41ef-8e0c-478a980ca9eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.358008 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.357888    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eccf25bc-6713-41ef-8e0c-478a980ca9eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.358092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eccf25bc-6713-41ef-8e0c-478a980ca9eb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.358092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358199 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358183    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vpl7\" (UniqueName: \"kubernetes.io/projected/01b3f66a-4583-4230-891e-451ceab7aa01-kube-api-access-6vpl7\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358252 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358205    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b3f66a-4583-4230-891e-451ceab7aa01-metrics-client-ca\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358252 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358220    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-root\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358249    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-accelerators-collector-config\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-textfile\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdmvj\" (UniqueName: \"kubernetes.io/projected/eccf25bc-6713-41ef-8e0c-478a980ca9eb-kube-api-access-pdmvj\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.358361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-sys\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358612 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358388    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-tls\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.358833 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.358811    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eccf25bc-6713-41ef-8e0c-478a980ca9eb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.360178 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.360157    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eccf25bc-6713-41ef-8e0c-478a980ca9eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.360363 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.360346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eccf25bc-6713-41ef-8e0c-478a980ca9eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.367048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.367029    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdmvj\" (UniqueName: \"kubernetes.io/projected/eccf25bc-6713-41ef-8e0c-478a980ca9eb-kube-api-access-pdmvj\") pod \"openshift-state-metrics-657fd6c54-7nrbs\" (UID: \"eccf25bc-6713-41ef-8e0c-478a980ca9eb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.459237 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459151    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-wtmp\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459237 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459198    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459237 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpl7\" (UniqueName: \"kubernetes.io/projected/01b3f66a-4583-4230-891e-451ceab7aa01-kube-api-access-6vpl7\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b3f66a-4583-4230-891e-451ceab7aa01-metrics-client-ca\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-root\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459292    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-accelerators-collector-config\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459327    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-textfile\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459346    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-wtmp\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-sys\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459373    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-root\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459406    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01b3f66a-4583-4230-891e-451ceab7aa01-sys\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459415    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-tls\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.459925 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:20.459532    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 07 17:10:20.459925 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:20.459614    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-tls podName:01b3f66a-4583-4230-891e-451ceab7aa01 nodeName:}" failed. No retries permitted until 2026-09-07 17:10:20.9595918 +0000 UTC m=+106.696400205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-tls") pod "node-exporter-vwc7b" (UID: "01b3f66a-4583-4230-891e-451ceab7aa01") : secret "node-exporter-tls" not found
Sep 07 17:10:20.459925 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.459718    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-textfile\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.460091 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.460004    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b3f66a-4583-4230-891e-451ceab7aa01-metrics-client-ca\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.460091 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.460016    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-accelerators-collector-config\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.461933 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.461915    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.470458 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.470433    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpl7\" (UniqueName: \"kubernetes.io/projected/01b3f66a-4583-4230-891e-451ceab7aa01-kube-api-access-6vpl7\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.494364 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.494342    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"
Sep 07 17:10:20.802927 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.802841    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs"]
Sep 07 17:10:20.807453 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:10:20.807422    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccf25bc_6713_41ef_8e0c_478a980ca9eb.slice/crio-5052b8d15fa08ec6fa329b24a4aa4975f8d892d95182498ee4141173c2f20149 WatchSource:0}: Error finding container 5052b8d15fa08ec6fa329b24a4aa4975f8d892d95182498ee4141173c2f20149: Status 404 returned error can't find the container with id 5052b8d15fa08ec6fa329b24a4aa4975f8d892d95182498ee4141173c2f20149
Sep 07 17:10:20.964165 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.964133    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-tls\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:20.966434 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:20.966416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01b3f66a-4583-4230-891e-451ceab7aa01-node-exporter-tls\") pod \"node-exporter-vwc7b\" (UID: \"01b3f66a-4583-4230-891e-451ceab7aa01\") " pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:21.139707 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:21.139675    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vwc7b"
Sep 07 17:10:21.163909 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:10:21.163882    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b3f66a_4583_4230_891e_451ceab7aa01.slice/crio-0caf91ba16f67b5757ad59576dc28d0a32d857c16761b55c7384a5ed06f61636 WatchSource:0}: Error finding container 0caf91ba16f67b5757ad59576dc28d0a32d857c16761b55c7384a5ed06f61636: Status 404 returned error can't find the container with id 0caf91ba16f67b5757ad59576dc28d0a32d857c16761b55c7384a5ed06f61636
Sep 07 17:10:21.283172 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:21.283140    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs" event={"ID":"eccf25bc-6713-41ef-8e0c-478a980ca9eb","Type":"ContainerStarted","Data":"68350670bc502c0b4335bc6595a7e2e8bf0366fef18eeac33ce933a05d1e9661"}
Sep 07 17:10:21.283334 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:21.283196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs" event={"ID":"eccf25bc-6713-41ef-8e0c-478a980ca9eb","Type":"ContainerStarted","Data":"167d32ceaa951cd40a43e2b3c948e3b16f0e020acaf8fe1033bc6930b770e8bb"}
Sep 07 17:10:21.283334 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:21.283223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs" event={"ID":"eccf25bc-6713-41ef-8e0c-478a980ca9eb","Type":"ContainerStarted","Data":"5052b8d15fa08ec6fa329b24a4aa4975f8d892d95182498ee4141173c2f20149"}
Sep 07 17:10:21.284344 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:21.284318    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwc7b" event={"ID":"01b3f66a-4583-4230-891e-451ceab7aa01","Type":"ContainerStarted","Data":"0caf91ba16f67b5757ad59576dc28d0a32d857c16761b55c7384a5ed06f61636"}
Sep 07 17:10:22.281366 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:22.281327    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:22.281847 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:22.281392    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:22.286215 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:22.286193    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:22.292321 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:22.292299    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:23.163033 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.162998    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"]
Sep 07 17:10:23.182470 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.182438    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.183041 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.183014    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"]
Sep 07 17:10:23.185950 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.185929    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 07 17:10:23.186061 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.185929    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-96eism4gk8omi\""
Sep 07 17:10:23.186121 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.186067    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 07 17:10:23.186367 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.186346    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 07 17:10:23.186367 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.186357    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 07 17:10:23.186503 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.186485    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 07 17:10:23.186833 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.186812    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xgkrm\""
Sep 07 17:10:23.282456 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-metrics-client-ca\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282456 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282481    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-grpc-tls\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8lbq\" (UniqueName: \"kubernetes.io/projected/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-kube-api-access-f8lbq\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-tls\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.282917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.282603    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.293400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.293371    2566 generic.go:356] "Generic (PLEG): container finished" podID="01b3f66a-4583-4230-891e-451ceab7aa01" containerID="d0c63dd37bb231d2ddba396d9ff8091937f4030e3d96453407153428698c5802" exitCode=0
Sep 07 17:10:23.293542 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.293461    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwc7b" event={"ID":"01b3f66a-4583-4230-891e-451ceab7aa01","Type":"ContainerDied","Data":"d0c63dd37bb231d2ddba396d9ff8091937f4030e3d96453407153428698c5802"}
Sep 07 17:10:23.295766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.295719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs" event={"ID":"eccf25bc-6713-41ef-8e0c-478a980ca9eb","Type":"ContainerStarted","Data":"8260821b680f8edbd31e856b13bae790fef2d8393397c95104249c6888984a2e"}
Sep 07 17:10:23.359554 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.359499    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7nrbs" podStartSLOduration=1.757449043 podStartE2EDuration="3.359482361s" totalImagesPullingTime="1.602033318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:23.358662707 +0000 UTC m=+109.095471119" watchObservedRunningTime="2026-09-07 17:10:23.359482361 +0000 UTC m=+109.096290774"
Sep 07 17:10:23.383943 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.383919    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-metrics-client-ca\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384062 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.383981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384062 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-grpc-tls\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384062 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384211 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8lbq\" (UniqueName: \"kubernetes.io/projected/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-kube-api-access-f8lbq\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384211 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-tls\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384301 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384354 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384332    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.384920 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.384898    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-metrics-client-ca\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.386708 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.386686    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.387155 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.387132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-grpc-tls\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.387254 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.387131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.387915 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.387891    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.387990 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.387963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.388029 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.387968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-secret-thanos-querier-tls\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.393524 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.393493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8lbq\" (UniqueName: \"kubernetes.io/projected/ae27bfaa-f539-427c-a56a-2abd04e0a9cb-kube-api-access-f8lbq\") pod \"thanos-querier-6ffc447d8f-qlbbj\" (UID: \"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\") " pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.492349 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.492325    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:23.806964 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:23.806890    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"]
Sep 07 17:10:23.810326 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:10:23.810301    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae27bfaa_f539_427c_a56a_2abd04e0a9cb.slice/crio-c7aa687c76ab74a8d0951266fb0ab199fa4e5522735d761853d050949c37c769 WatchSource:0}: Error finding container c7aa687c76ab74a8d0951266fb0ab199fa4e5522735d761853d050949c37c769: Status 404 returned error can't find the container with id c7aa687c76ab74a8d0951266fb0ab199fa4e5522735d761853d050949c37c769
Sep 07 17:10:24.107361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.107327    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6496748dfb-bwvvw"]
Sep 07 17:10:24.301027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.300987    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"c7aa687c76ab74a8d0951266fb0ab199fa4e5522735d761853d050949c37c769"}
Sep 07 17:10:24.303690 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.303654    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwc7b" event={"ID":"01b3f66a-4583-4230-891e-451ceab7aa01","Type":"ContainerStarted","Data":"10becd94a59f66d6ff3196fbd795a333b6226e30fde9a7c3bb1101cde61cebe3"}
Sep 07 17:10:24.303847 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.303719    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vwc7b" event={"ID":"01b3f66a-4583-4230-891e-451ceab7aa01","Type":"ContainerStarted","Data":"bbd33521b786dc9703d4b1f556f61c7405d41223572f50dc058ccf520b7f5289"}
Sep 07 17:10:24.355059 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.354903    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vwc7b" podStartSLOduration=2.782432538 podStartE2EDuration="4.354880486s" totalImagesPullingTime="1.501507478s" totalInitContainerRuntime="70.94047ms" isStatefulPod=true podCreationTimestamp="2026-09-07 17:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:24.353974354 +0000 UTC m=+110.090782766" watchObservedRunningTime="2026-09-07 17:10:24.354880486 +0000 UTC m=+110.091688982"
Sep 07 17:10:24.834001 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.833961    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"]
Sep 07 17:10:24.853047 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.853018    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"]
Sep 07 17:10:24.853199 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.853120    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:24.856163 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.856131    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 17:10:24.856306 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.856219    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6qgbb\""
Sep 07 17:10:24.999761 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.999709    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5287c3e5-6354-4fa1-a71c-a7ae364fd3ab-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-g7gn2\" (UID: \"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:24.999941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:24.999780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57gjk\" (UniqueName: \"kubernetes.io/projected/5287c3e5-6354-4fa1-a71c-a7ae364fd3ab-kube-api-access-57gjk\") pod \"monitoring-plugin-85bbbbbf4-g7gn2\" (UID: \"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:25.100218 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:25.100122    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57gjk\" (UniqueName: \"kubernetes.io/projected/5287c3e5-6354-4fa1-a71c-a7ae364fd3ab-kube-api-access-57gjk\") pod \"monitoring-plugin-85bbbbbf4-g7gn2\" (UID: \"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:25.100392 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:25.100248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5287c3e5-6354-4fa1-a71c-a7ae364fd3ab-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-g7gn2\" (UID: \"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:25.102907 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:25.102882    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5287c3e5-6354-4fa1-a71c-a7ae364fd3ab-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-g7gn2\" (UID: \"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:25.109369 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:25.109347    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57gjk\" (UniqueName: \"kubernetes.io/projected/5287c3e5-6354-4fa1-a71c-a7ae364fd3ab-kube-api-access-57gjk\") pod \"monitoring-plugin-85bbbbbf4-g7gn2\" (UID: \"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:25.162445 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:25.162410    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:25.750362 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:25.750284    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"]
Sep 07 17:10:25.842549 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:10:25.842512    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5287c3e5_6354_4fa1_a71c_a7ae364fd3ab.slice/crio-b7ce1149d5fe6377fc8fab2b0dbc3adfe27352d69d70b6c9027aa1690533d7d9 WatchSource:0}: Error finding container b7ce1149d5fe6377fc8fab2b0dbc3adfe27352d69d70b6c9027aa1690533d7d9: Status 404 returned error can't find the container with id b7ce1149d5fe6377fc8fab2b0dbc3adfe27352d69d70b6c9027aa1690533d7d9
Sep 07 17:10:26.313914 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.313825    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a"}
Sep 07 17:10:26.314081 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.313935    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995"}
Sep 07 17:10:26.314081 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.313971    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76"}
Sep 07 17:10:26.315170 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.315132    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2" event={"ID":"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab","Type":"ContainerStarted","Data":"b7ce1149d5fe6377fc8fab2b0dbc3adfe27352d69d70b6c9027aa1690533d7d9"}
Sep 07 17:10:26.534340 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.534308    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:10:26.549803 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.549774    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.552910 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.552871    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 17:10:26.553046 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.552882    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 17:10:26.553109 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.553094    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 17:10:26.553234 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.553209    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 17:10:26.553234 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.553218    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 17:10:26.557147 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.557126    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 17:10:26.557382 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.557366    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 17:10:26.557575 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.557551    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jfpb6\""
Sep 07 17:10:26.558423 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.557777    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 17:10:26.558423 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.557859    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 17:10:26.558423 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.558114    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 17:10:26.558423 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.558271    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 17:10:26.559253 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.559137    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 17:10:26.559450 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.559424    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 17:10:26.559596 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.559558    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 17:10:26.566336 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.559923    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-37qub8gpb67np\""
Sep 07 17:10:26.566671 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.566647    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 17:10:26.566767 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.564939    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:10:26.710879 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.710842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711060 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.710890    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711060 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.710920    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-config\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711060 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.710947    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711060 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.710973    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ntw5\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-kube-api-access-4ntw5\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711060 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711284 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711284 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711161    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711284 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711284 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711262    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711317    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711371    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711469    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711516    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711533    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711550    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711571    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.711630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.711588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.812661 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812619    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812669    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812699    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812726    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812793    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812851    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812873    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812927    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.812975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813000    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813026    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-config\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813049    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813073    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ntw5\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-kube-api-access-4ntw5\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813103    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813975 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813184    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813975 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813202    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813975 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813327    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.813975 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.813474    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.816809    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.816980    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.818403    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.819099    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.819136    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.819471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.819682    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.819811    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.820694 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.820641    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-config\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.821549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.821507    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.821660 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.821604    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.824246 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.824224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ntw5\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-kube-api-access-4ntw5\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.825506 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.825475    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.825620 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.825596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.825687 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.825599    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.825899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.825875    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.826007 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.825967    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.828184 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.828166    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:26.892078 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:26.892040    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:27.825292 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:27.825265    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:10:27.828015 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:10:27.827988    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a314891_1fa5_40e0_ae68_3d31462d04e7.slice/crio-05bc33f944022200653eaa43514c0425948992f6b609701b5dfafd76a792a161 WatchSource:0}: Error finding container 05bc33f944022200653eaa43514c0425948992f6b609701b5dfafd76a792a161: Status 404 returned error can't find the container with id 05bc33f944022200653eaa43514c0425948992f6b609701b5dfafd76a792a161
Sep 07 17:10:28.328373 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.328229    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06"}
Sep 07 17:10:28.328606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.328430    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e"}
Sep 07 17:10:28.328606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.328481    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" event={"ID":"ae27bfaa-f539-427c-a56a-2abd04e0a9cb","Type":"ContainerStarted","Data":"8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2"}
Sep 07 17:10:28.328606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.328526    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:28.330690 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.330653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2" event={"ID":"5287c3e5-6354-4fa1-a71c-a7ae364fd3ab","Type":"ContainerStarted","Data":"9b4fc063dfa250793eeb106a65e81d7f1ebab333bc126a69a227fea1d7b3b1d7"}
Sep 07 17:10:28.331445 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.331239    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:28.335680 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.335641    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"05bc33f944022200653eaa43514c0425948992f6b609701b5dfafd76a792a161"}
Sep 07 17:10:28.338302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.338282    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2"
Sep 07 17:10:28.361119 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.361074    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj" podStartSLOduration=1.94966728 podStartE2EDuration="5.361056687s" totalImagesPullingTime="3.411389407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:28.361008956 +0000 UTC m=+114.097817369" watchObservedRunningTime="2026-09-07 17:10:28.361056687 +0000 UTC m=+114.097865100"
Sep 07 17:10:28.385846 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:28.385802    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-g7gn2" podStartSLOduration=2.713751583 podStartE2EDuration="4.385790103s" totalImagesPullingTime="1.67203852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:10:28.384784344 +0000 UTC m=+114.121592759" watchObservedRunningTime="2026-09-07 17:10:28.385790103 +0000 UTC m=+114.122598514"
Sep 07 17:10:29.342091 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:29.342039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"}
Sep 07 17:10:30.348068 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:30.348037    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce" exitCode=0
Sep 07 17:10:30.348463 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:30.348133    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"}
Sep 07 17:10:30.394114 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:30.394064    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:33.494807 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:33.494774    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdvlb_a223c599-943b-426d-8a68-f22abe23b63b/serve-healthcheck-canary/0.log"
Sep 07 17:10:34.348328 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.348307    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:34.370889 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.370854    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"}
Sep 07 17:10:34.370989 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.370946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"}
Sep 07 17:10:34.370989 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.370976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"}
Sep 07 17:10:34.371061 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.371001    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"}
Sep 07 17:10:34.371061 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.371039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"}
Sep 07 17:10:34.371129 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:34.371064    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerStarted","Data":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"}
Sep 07 17:10:36.893006 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:36.892965    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:41.523978 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:41.523841    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:41.562528 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:41.562474    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:41.586769 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:41.586657    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:41.634328 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:41.634178    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:41.672002 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:41.671914    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:41.702509 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:41.702377    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:44.817639 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:44.817329    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:44.854219 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:44.854074    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:47.687066 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:47.686873    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:47.713365 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:47.713234    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:47.746320 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:47.746166    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:47.771491 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:47.771368    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:47.802890 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:47.802763    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:47Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:47.802890 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:47.802886    2566 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Sep 07 17:10:49.324979 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.324941    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6496748dfb-bwvvw" podUID="348b2ab2-fb0b-45bf-aa1c-fefde9178500" containerName="console" containerID="cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93" gracePeriod=15
Sep 07 17:10:49.597205 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.597160    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:49.619527 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:49.619427    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:49.654000 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:49.650017    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:49.678071 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:49.678018    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"348b2ab2-fb0b-45bf-aa1c-fefde9178500\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"reason\\\":\\\"PodCompleted\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:16Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000210000],\\\"uid\\\":1000210000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/serving-cert\\\",\\\"name\\\":\\\"console-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-config\\\",\\\"name\\\":\\\"console-oauth-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/console-config\\\",\\\"name\\\":\\\"console-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/service-ca\\\",\\\"name\\\":\\\"service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-serving-cert\\\",\\\"name\\\":\\\"oauth-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mpbqd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Succeeded\\\"}}\" for pod \"openshift-console\"/\"console-6496748dfb-bwvvw\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:49.698290 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698268    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpbqd\" (UniqueName: \"kubernetes.io/projected/348b2ab2-fb0b-45bf-aa1c-fefde9178500-kube-api-access-mpbqd\") pod \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") "
Sep 07 17:10:49.698393 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698299    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-service-ca\") pod \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") "
Sep 07 17:10:49.698393 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698326    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-serving-cert\") pod \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") "
Sep 07 17:10:49.698393 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698351    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-config\") pod \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") "
Sep 07 17:10:49.698393 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698365    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-oauth-serving-cert\") pod \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") "
Sep 07 17:10:49.698589 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698422    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-oauth-config\") pod \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\" (UID: \"348b2ab2-fb0b-45bf-aa1c-fefde9178500\") "
Sep 07 17:10:49.698828 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698801    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-service-ca" (OuterVolumeSpecName: "service-ca") pod "348b2ab2-fb0b-45bf-aa1c-fefde9178500" (UID: "348b2ab2-fb0b-45bf-aa1c-fefde9178500"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:49.698917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698798    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-config" (OuterVolumeSpecName: "console-config") pod "348b2ab2-fb0b-45bf-aa1c-fefde9178500" (UID: "348b2ab2-fb0b-45bf-aa1c-fefde9178500"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:49.698917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.698895    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "348b2ab2-fb0b-45bf-aa1c-fefde9178500" (UID: "348b2ab2-fb0b-45bf-aa1c-fefde9178500"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:10:49.700776 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.700714    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "348b2ab2-fb0b-45bf-aa1c-fefde9178500" (UID: "348b2ab2-fb0b-45bf-aa1c-fefde9178500"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:10:49.700883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.700775    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/348b2ab2-fb0b-45bf-aa1c-fefde9178500-kube-api-access-mpbqd" (OuterVolumeSpecName: "kube-api-access-mpbqd") pod "348b2ab2-fb0b-45bf-aa1c-fefde9178500" (UID: "348b2ab2-fb0b-45bf-aa1c-fefde9178500"). InnerVolumeSpecName "kube-api-access-mpbqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:10:49.700883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.700855    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "348b2ab2-fb0b-45bf-aa1c-fefde9178500" (UID: "348b2ab2-fb0b-45bf-aa1c-fefde9178500"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:10:49.799048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.799017    2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:10:49.799048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.799042    2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-oauth-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:10:49.799048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.799052    2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-oauth-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:10:49.799258 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.799061    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpbqd\" (UniqueName: \"kubernetes.io/projected/348b2ab2-fb0b-45bf-aa1c-fefde9178500-kube-api-access-mpbqd\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:10:49.799258 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.799090    2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/348b2ab2-fb0b-45bf-aa1c-fefde9178500-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:10:49.799258 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:49.799099    2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/348b2ab2-fb0b-45bf-aa1c-fefde9178500-console-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:10:50.435427 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.435386    2566 generic.go:356] "Generic (PLEG): container finished" podID="348b2ab2-fb0b-45bf-aa1c-fefde9178500" containerID="41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93" exitCode=0
Sep 07 17:10:50.435882 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.435452    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:50.435882 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.435450    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496748dfb-bwvvw" event={"ID":"348b2ab2-fb0b-45bf-aa1c-fefde9178500","Type":"ContainerDied","Data":"41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93"}
Sep 07 17:10:50.435882 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.435564    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6496748dfb-bwvvw" event={"ID":"348b2ab2-fb0b-45bf-aa1c-fefde9178500","Type":"ContainerDied","Data":"45e6b4baf8289aa9087096ef956e5521eb1d379d02ac2636820bc3ad3ae64505"}
Sep 07 17:10:50.435882 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.435588    2566 scope.go:117] "RemoveContainer" containerID="41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93"
Sep 07 17:10:50.444152 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.444132    2566 scope.go:117] "RemoveContainer" containerID="41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93"
Sep 07 17:10:50.444460 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.444437    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\": container with ID starting with 41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93 not found: ID does not exist" containerID="41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93"
Sep 07 17:10:50.444515 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:10:50.444468    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93"} err="failed to get container status \"41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\": rpc error: code = NotFound desc = could not find container \"41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\": container with ID starting with 41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93 not found: ID does not exist"
Sep 07 17:10:50.457744 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.457687    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"348b2ab2-fb0b-45bf-aa1c-fefde9178500\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"reason\\\":\\\"PodCompleted\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:16Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000210000],\\\"uid\\\":1000210000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/serving-cert\\\",\\\"name\\\":\\\"console-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-config\\\",\\\"name\\\":\\\"console-oauth-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/console-config\\\",\\\"name\\\":\\\"console-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/service-ca\\\",\\\"name\\\":\\\"service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-serving-cert\\\",\\\"name\\\":\\\"oauth-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mpbqd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Succeeded\\\"}}\" for pod \"openshift-console\"/\"console-6496748dfb-bwvvw\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:50.492523 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.492423    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:50.533563 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.533422    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:50.573105 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.573002    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:50.617934 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.617777    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:50.643376 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:50.643317    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"348b2ab2-fb0b-45bf-aa1c-fefde9178500\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"reason\\\":\\\"PodCompleted\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:16Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000210000],\\\"uid\\\":1000210000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/serving-cert\\\",\\\"name\\\":\\\"console-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-config\\\",\\\"name\\\":\\\"console-oauth-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/console-config\\\",\\\"name\\\":\\\"console-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/service-ca\\\",\\\"name\\\":\\\"service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-serving-cert\\\",\\\"name\\\":\\\"oauth-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mpbqd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Succeeded\\\"}}\" for pod \"openshift-console\"/\"console-6496748dfb-bwvvw\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:54.795589 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:54.795485    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ae27bfaa-f539-427c-a56a-2abd04e0a9cb\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:34Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://7c47a9de4fc5c1193fd310f460139b3db56df49671c015fbe49b1aa4da275b7a\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://9a2839db62692dba9dc94794633bfa27b1318cdb51faf190053888bdd5682f06\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-metrics\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://d5e8f3ee5b7bef62886d0c21470c7e15eb9901b374f887f00ad2d829ddb0944e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-rules\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-rules\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://ea22571150cef64af27a1c878a6bc60edde66c145352a9be348ea3bc5d7fe995\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:26Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-thanos-querier-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-thanos-querier-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://8813b34d2635b9daac90680f4cf61fc64a09fa7abe4661a83695cbec647b84c2\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prom-label-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:27Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"},\\\"containerID\\\":\\\"cri-o://b398f6051d50d01f5ce09fdcec63e68b83821568375de75a73f6aa3e7dfa8d76\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-query\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"12Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:25Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000440000],\\\"uid\\\":1000440000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-f8lbq\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-monitoring\"/\"thanos-querier-6ffc447d8f-qlbbj\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/thanos-querier-6ffc447d8f-qlbbj"
Sep 07 17:10:54.834594 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:54.834404    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9a314891-1fa5-40e0-ae68-3d31462d04e7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:30Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"message\\\":\\\"containers with unready status: [prometheus]\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-thanos\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/tls/client\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"},\\\"containerID\\\":\\\"cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-web\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"15Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:34Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/private\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\"},{\\\"mountPath\\\":\\\"/etc/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"},\\\"containerID\\\":\\\"cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"prometheus\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"70m\\\",\\\"memory\\\":\\\"1Gi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/pki/ca-trust/extracted/pem/\\\",\\\"name\\\":\\\"prometheus-trusted-ca-bundle\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/certs\\\",\\\"name\\\":\\\"tls-assets\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/prometheus\\\",\\\"name\\\":\\\"prometheus-k8s-db\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-thanos-sidecar-tls\\\",\\\"name\\\":\\\"secret-prometheus-k8s-thanos-sidecar-tls\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/kube-rbac-proxy\\\",\\\"name\\\":\\\"secret-kube-rbac-proxy\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/prometheus-k8s-kube-rbac-proxy-web\\\",\\\"name\\\":\\\"secret-prometheus-k8s-kube-rbac-proxy-web\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/secrets/metrics-client-certs\\\",\\\"name\\\":\\\"secret-metrics-client-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/serving-certs-ca-bundle\\\",\\\"name\\\":\\\"configmap-serving-certs-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/kubelet-serving-ca-bundle\\\",\\\"name\\\":\\\"configmap-kubelet-serving-ca-bundle\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/configmaps/metrics-client-ca\\\",\\\"name\\\":\\\"configmap-metrics-client-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"},\\\"containerID\\\":\\\"cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"thanos-sidecar\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"25Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-09-07T17:10:33Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/tls/grpc\\\",\\\"name\\\":\\\"secret-grpc-tls\\\"},{\\\"mountPath\\\":\\\"/etc/thanos/config\\\",\\\"name\\\":\\\"thanos-prometheus-http-client-file\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"init-config-reloader\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"1m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:29Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:29Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/etc/prometheus/config\\\",\\\"name\\\":\\\"config\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/config_out\\\",\\\"name\\\":\\\"config-out\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/web_config/web-config.yaml\\\",\\\"name\\\":\\\"web-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-0\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-0\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-1\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-1\\\"},{\\\"mountPath\\\":\\\"/etc/prometheus/rules/prometheus-k8s-rulefiles-2\\\",\\\"name\\\":\\\"prometheus-k8s-rulefiles-2\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-4ntw5\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\",\\\"podIP\\\":\\\"10.134.0.16\\\",\\\"podIPs\\\":[{\\\"ip\\\":\\\"10.134.0.16\\\"}]}}\" for pod \"openshift-monitoring\"/\"prometheus-k8s-0\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:10:54.855158 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:54.855103    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"348b2ab2-fb0b-45bf-aa1c-fefde9178500\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"reason\\\":\\\"PodCompleted\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"PodCompleted\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"},\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"console\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"100Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://41827361b48e24b2e8c70e4019da0dbdd480d8d9332c859d974064f4ec605a93\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-09-07T17:10:49Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-09-07T17:10:16Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000210000],\\\"uid\\\":1000210000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/serving-cert\\\",\\\"name\\\":\\\"console-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-config\\\",\\\"name\\\":\\\"console-oauth-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/console-config\\\",\\\"name\\\":\\\"console-config\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/service-ca\\\",\\\"name\\\":\\\"service-ca\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/oauth-serving-cert\\\",\\\"name\\\":\\\"oauth-serving-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-mpbqd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Succeeded\\\"}}\" for pod \"openshift-console\"/\"console-6496748dfb-bwvvw\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/pod?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused" pod="openshift-console/console-6496748dfb-bwvvw"
Sep 07 17:10:58.065107 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:58.064983    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:58.093644 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:58.093519    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:58.121898 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:58.121779    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:58.149447 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:58.149329    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:58.212364 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:58.212234    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-07T17:10:58Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:054a63dd511bcea6ec4db8121e3f63104b13278216b7c834302188d3816a5dd3\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5fc7d86b696f56a056fc91ba7174c153ec6e514eae541e4993ccf8eacbef3e2c\\\"],\\\"sizeBytes\\\":2071253520},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4ff4684e81eda96da31b31effc7526407ab4240ab95dbd354e9d6cf7c080d1a5\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff86545c65970d36d4ced99fee46fd9a5a7590e379152c8c728eb1f29970dce0\\\"],\\\"sizeBytes\\\":1191140208},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cfde312743ce0a1d3f82fc68e67e64a3fca57853ed9c621b1fe74db36e5943ea\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d70ac620aaa7a359b6f946c7bbc7c43ec8f662e3dbc01a81bd3b874a50d8ceda\\\"],\\\"sizeBytes\\\":1187853995},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3863ee2168370cd55c84fc19f023ca4f9af4ba51c20443d7a6736e4099040ec6\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7a667dfb8d993459f4da0daac5ac73a74d860d523a74dbe9fe585e023862ba49\\\"],\\\"sizeBytes\\\":880865337},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4df5726479a4318422f562945c7cea7d73050af86def291ece6bcd0d5f671334\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8f39c1daa89e19c5e987a3b759e646ffab6c1b2ab94a97ded81ddf13e73d0399\\\"],\\\"sizeBytes\\\":591237733},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:526a2ac4ac8a3b16cc43e71f40cd285f79666513fb48205338da74737b4cfc31\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:feb1137f1c622b2ed3fd7864ae97b30c49ca40be335e968e733ae1387f619486\\\"],\\\"sizeBytes\\\":585209957},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9c68cfdf784793c266ed7fae433db183b4521a7bf34f1a63d7c2c410da6c05d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e65a8a319bd1e96e1eae496e0eb389dd5cabc8fbc7bab1f92eb74728b74ecf27\\\"],\\\"sizeBytes\\\":580711434},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1c6b55e6f6dc3f07ab2626923169873734c7376bf8660d673a127e97047ed6ce\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:34db7d14a3db6337de33719bd3025cda31d8b37717af24b6037967f43a8739f4\\\"],\\\"sizeBytes\\\":542930692},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ae94765f5512d153ca58b4da21adbc6dcefbacd9631ab6416da80ad270866630\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b1311c2217d4fd7cb932b0ce7682ead73b65f6c0211a54241e7fd807135c5cd3\\\"],\\\"sizeBytes\\\":479474128},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:399e68fa23665c69938366fdc04639a184686afe6786763a9426fef843148e82\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:602e04dc7e5aa127c231a39d35a6271ada557045ff0ce999454898cfa7a0e88c\\\"],\\\"sizeBytes\\\":460953253},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6d6a9d94f5df316cf2ebf6bed9a19dbf1bf506dae0e2f15792c1dcce818e2146\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a9b492b260407a9e94419d1ba959aee98addc71f43727d884bf384001dd8e90a\\\"],\\\"sizeBytes\\\":443008130},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:31f886d680e8409c2a25409445b0b1c2a87d18f297a7b0ed01216d07e36d6768\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f97cdd83d19e4e52a5bb1f4767a09012d2e6ad45c78f64fabd0aa9bfda98c439\\\"],\\\"sizeBytes\\\":391508249},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2715231eb5735496339b35b0019240e8ed476f49005c78a9b0282fff549b316e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:442f6f711db8a6f8fae4dfff48a29e5fb0d154b2c6779c5e2e46d649f99ccfec\\\"],\\\"sizeBytes\\\":353954431},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:40bc1b9c6b608369978e9f165c5e22d7a75fd91b3480cba60cd275228d721616\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b791ac4a74fb40f5560b4ee0887bab8d3cd5115c5423349724fd65cdbf525d8\\\"],\\\"sizeBytes\\\":351323595},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0d2fae617617ccbdef514e3068eb3db7ed6f5869fe748bbfc9d66eb536d3e26f\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e1b0c1ab26ecd2490e7084728c14cee5298a3d8697acc8d2c75021a2f7ad1f75\\\"],\\\"sizeBytes\\\":348544277},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5b1ff8bcc054ed7be8c75425b62556636cd8aecdbe80bef66cca23d94c8e7897\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e8f2a2d246ba9a61b7c1ac9bdaf8cf2761db37ada8085c486670995c8281723d\\\"],\\\"sizeBytes\\\":329663441},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:1483a45f7f5e30c4dc46b45edcbb4b3f83cb20153c8153e2663989ee0fcd4e1e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f07372c9659382347c892a0489ee20746fd78a745fc570697fed5635ac94c20\\\"],\\\"sizeBytes\\\":322850422},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ca84fc8b10f7856b22f27b4ad37d3f03f9bed9c51904a00e640f21ea99d49487\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1\\\"],\\\"sizeBytes\\\":321671430},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:069a7c6581b9d90c26f110eba7bd568c1a63bc4c0c3101b806ee9619b5eff81e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dcaa1d46224a73ba469d38c7a644f6cf5a1276f0b38c78d6bee6785177ec7162\\\"],\\\"sizeBytes\\\":317668265},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9018c47455af82aa9aba488b18f1fb9824a505ad46539494602fe936ffc4b601\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f24daee8722c23f953d9eb0f79bd54791c87e5c3b5c46eb5d9f04aeabe6c7c5f\\\"],\\\"sizeBytes\\\":288598319},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:095960e9b22d8660a23c0cdcd3a7961988ea355e189f9faf9008a7e2a0824286\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924fcb9b7fe53e9cdd1b799ec020159588f018457a2c9f24a3aa4d960c34ccbf\\\"],\\\"sizeBytes\\\":286680505},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2afe1e650f7a2bc2eb7ce312884b1269e46e09583911137ab152cedc3a022511\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:cec847b1f08cae0315bd44fe477d725a0180b78ab0ad844de3b218bf2dde0bb2\\\"],\\\"sizeBytes\\\":282837706},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:611923c6547c07359fb9a54e45160fd3e4fdf235ecc384b7ddb60c7c8a833c30\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:645502fbd4c3db315606079417b88d84aa7f1ebd1df919d0802ea58aa2715962\\\"],\\\"sizeBytes\\\":271274301},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a70be470f96982ba7268063eb7c4fe415449eaf2d606b9e85869953dc2b82606\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a784ec121451d2e3412178bd13c80a7381e5d423360c2ce5b4200bdee3b75b8d\\\"],\\\"sizeBytes\\\":259389101},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d8ec578bbd6716e84b3f12ae63e637d79aec1b16fb03556784b8ed5fce16d1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6cb6bdafd8554a7b8765137e45621fe33091c54b98ab962ff24e5f8c3fd2c531\\\"],\\\"sizeBytes\\\":254830869},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:35d1ee61dada1d62dcc613c552ad9918bd7d2a6132a081d53de4775d3d16841c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:6beed8f25b71249945ab6789b94880b9c061dc53d3bb9f4cad17a5ca9de88e29\\\"],\\\"sizeBytes\\\":253435945},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:015b604a274fa1896122e0e4690585b3a83549f7c8670931a798446eec8963d0\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4c487357748145bddf8d3d1f7036542da604a17f08f73602612838579d1bd3ac\\\"],\\\"sizeBytes\\\":252846435},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3771be49c2be65a1e1929a95d6710da097046eff5df33fa4b4c6ab2ffdb088fc\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee12b60d68efba56b0b464fd64791132138e1a120be3b7f13ff04ce97d7ab149\\\"],\\\"sizeBytes\\\":247614117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:076da7d59107bba89a1430a080176af4f83052296230df56d51b724cf03a169e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4e3a2f3c9f8d7a459ccd0719643fba2d050d158d387ade828c3d58813bc3b6e4\\\"],\\\"sizeBytes\\\":240112805},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:909d94acdf16bd26857849698608cb17db0c62ca3eab7d670ee858a6e839390e\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ead92f00c83a562232b8feac34089875e63ff76080039dc4c09e8ed9cc22d5fb\\\"],\\\"sizeBytes\\\":239854772},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b7540027380dafacdaf56cac1129e87b9081a45e3906f9363eb19d5a57ecf12\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e53129eef13d9deaac86d2e0f99a320d5b7b28d8347c5418169db98a679913de\\\"],\\\"sizeBytes\\\":229649173},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:dba6a8cc4601d0c588a8dde112534f8e60a458bec75034ab9ed7dac6d45d0875\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e35f17762fc3f961f361749a5e9d544b17011c64187f85e085c763204f33a113\\\"],\\\"sizeBytes\\\":227367336},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2ed6cd765c62307186d486139e35584ce657840609d2147d464cae3481404155\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ee7e710dffa2957f4ef74529a60af22f22f5e7846bcac2f8e8743cb57628b322\\\"],\\\"sizeBytes\\\":222920470},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fb1140d1be7f58dafc56142241b6733f8b60b960b64dcb57585ef17d9cc459b\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9f675d5827e7bef4552ea615e94b398c323676551997d51bec2e58778e962657\\\"],\\\"sizeBytes\\\":220121222},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bfe8897012a86426822069e3423480528ca16f1610a60eefd6bc70e0e140d941\\\"],\\\"sizeBytes\\\":210996836}]}}\" for node \"ip-10-0-138-5.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-ac4284c0-d934-4998-a228-c25a811a43dd.svc:9743/node?timeout=10s\": dial tcp 172.30.164.151:9743: connect: connection refused"
Sep 07 17:10:58.212364 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:10:58.212357    2566 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Sep 07 17:11:04.829934 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:04.829881    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=34.158805379 podStartE2EDuration="38.829862955s" totalImagesPullingTime="4.650429396s" totalInitContainerRuntime="20.62818ms" isStatefulPod=false podCreationTimestamp="2026-09-07 17:10:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:04.827765095 +0000 UTC m=+150.564573509" watchObservedRunningTime="2026-09-07 17:11:04.829862955 +0000 UTC m=+150.566671366"
Sep 07 17:11:04.865332 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:04.865301    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6496748dfb-bwvvw"]
Sep 07 17:11:04.869813 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:04.869786    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6496748dfb-bwvvw"]
Sep 07 17:11:06.771042 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:06.771009    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="348b2ab2-fb0b-45bf-aa1c-fefde9178500" path="/var/lib/kubelet/pods/348b2ab2-fb0b-45bf-aa1c-fefde9178500/volumes"
Sep 07 17:11:26.892629 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:26.892589    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:26.911447 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:26.911415    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:27.587943 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:27.587913    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.020350 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020313    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:11:45.020916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020591    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="prometheus" containerID="cri-o://ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22" gracePeriod=600
Sep 07 17:11:45.020916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020631    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-web" containerID="cri-o://07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b" gracePeriod=600
Sep 07 17:11:45.020916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020680    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="config-reloader" containerID="cri-o://a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e" gracePeriod=600
Sep 07 17:11:45.020916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020631    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007" gracePeriod=600
Sep 07 17:11:45.020916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020644    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy" containerID="cri-o://b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3" gracePeriod=600
Sep 07 17:11:45.020916 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.020654    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="thanos-sidecar" containerID="cri-o://19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7" gracePeriod=600
Sep 07 17:11:45.257965 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.257937    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.339771 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339726    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-2\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.339926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339781    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-kubelet-serving-ca-bundle\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.339926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339800    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-grpc-tls\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.339926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339826    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-kube-rbac-proxy\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.339926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339844    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.339926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339881    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-metrics-client-ca\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.339926 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339907    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-web-config\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339945    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-serving-certs-ca-bundle\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.339978    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-config\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340002    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-thanos-prometheus-http-client-file\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340027    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-db\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340067    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-tls\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340095    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-metrics-client-certs\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340096    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340130    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340157    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ntw5\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-kube-api-access-4ntw5\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340181    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-1\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340204 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340207    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-trusted-ca-bundle\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340233    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-config-out\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340271    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-tls-assets\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340291    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-0\") pod \"9a314891-1fa5-40e0-ae68-3d31462d04e7\" (UID: \"9a314891-1fa5-40e0-ae68-3d31462d04e7\") "
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340295    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340445    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340482    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340536    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340557    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.340789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.340574    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.341815 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.341787    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.341988 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.341961    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:45.342714 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.342681    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.343182 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.342849    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.343182 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.343089    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.343182 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.343129    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:11:45.343834 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.343791    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-kube-api-access-4ntw5" (OuterVolumeSpecName: "kube-api-access-4ntw5") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "kube-api-access-4ntw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:45.344645 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.344613    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.344755 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.344709    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-config" (OuterVolumeSpecName: "config") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.345242 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.345214    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.345528 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.345506    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.345607 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.345550    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:11:45.345607 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.345601    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.346072 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.346047    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.346205 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.346183    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-config-out" (OuterVolumeSpecName: "config-out") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:11:45.354497 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.354477    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-web-config" (OuterVolumeSpecName: "web-config") pod "9a314891-1fa5-40e0-ae68-3d31462d04e7" (UID: "9a314891-1fa5-40e0-ae68-3d31462d04e7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:11:45.441597 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441565    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441597 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441590    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ntw5\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-kube-api-access-4ntw5\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441597 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441601    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441610    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441622    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-config-out\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441630    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a314891-1fa5-40e0-ae68-3d31462d04e7-tls-assets\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441638    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441647    2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-grpc-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441655    2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-kube-rbac-proxy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441663    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441672    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a314891-1fa5-40e0-ae68-3d31462d04e7-configmap-metrics-client-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441679    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-web-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441687    2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441695    2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441702    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a314891-1fa5-40e0-ae68-3d31462d04e7-prometheus-k8s-db\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441710    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.441822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.441718    2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a314891-1fa5-40e0-ae68-3d31462d04e7-secret-metrics-client-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:11:45.658122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658032    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007" exitCode=0
Sep 07 17:11:45.658122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658058    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3" exitCode=0
Sep 07 17:11:45.658122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658066    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b" exitCode=0
Sep 07 17:11:45.658122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658073    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7" exitCode=0
Sep 07 17:11:45.658122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658066    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"}
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658130    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658078    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e" exitCode=0
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658159    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"}
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658164    2566 generic.go:356] "Generic (PLEG): container finished" podID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22" exitCode=0
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"}
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658184    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658215    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"}
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"}
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"}
Sep 07 17:11:45.658486 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.658295    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a314891-1fa5-40e0-ae68-3d31462d04e7","Type":"ContainerDied","Data":"05bc33f944022200653eaa43514c0425948992f6b609701b5dfafd76a792a161"}
Sep 07 17:11:45.666627 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.666610    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.673246 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.673230    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.680048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.680029    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.686433 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.686418    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.692684 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.692667    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.696821 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.696794    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:11:45.700247 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.700227    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.703062 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.703040    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:11:45.707071 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707056    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.707344 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.707322    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.707387 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707352    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"} err="failed to get container status \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist"
Sep 07 17:11:45.707387 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707369    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.707614 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.707598    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.707655 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707621    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"} err="failed to get container status \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist"
Sep 07 17:11:45.707655 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707637    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.707874 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.707857    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.707922 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707879    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"} err="failed to get container status \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist"
Sep 07 17:11:45.707922 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.707892    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.708116 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.708081    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.708166 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708120    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"} err="failed to get container status \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist"
Sep 07 17:11:45.708166 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708134    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.708321 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.708307    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.708366 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708322    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"} err="failed to get container status \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist"
Sep 07 17:11:45.708366 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708332    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.708508 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.708494    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.708546 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708509    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"} err="failed to get container status \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist"
Sep 07 17:11:45.708546 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708520    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.708707 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:11:45.708694    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.708765 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708708    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"} err="failed to get container status \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist"
Sep 07 17:11:45.708765 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708719    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.709010 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.708992    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"} err="failed to get container status \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist"
Sep 07 17:11:45.709063 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709011    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.709210 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709194    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"} err="failed to get container status \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist"
Sep 07 17:11:45.709260 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709209    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.709433 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709416    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"} err="failed to get container status \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist"
Sep 07 17:11:45.709433 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709433    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.709678 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709659    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"} err="failed to get container status \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist"
Sep 07 17:11:45.709724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709679    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.709899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709879    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"} err="failed to get container status \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist"
Sep 07 17:11:45.709942 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.709900    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.710131 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710114    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"} err="failed to get container status \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist"
Sep 07 17:11:45.710175 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710131    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.710334 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710318    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"} err="failed to get container status \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist"
Sep 07 17:11:45.710376 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710335    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.710559 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710543    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"} err="failed to get container status \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist"
Sep 07 17:11:45.710604 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710559    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.710771 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710754    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"} err="failed to get container status \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist"
Sep 07 17:11:45.710818 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710771    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.711012 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.710993    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"} err="failed to get container status \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist"
Sep 07 17:11:45.711063 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711013    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.711237 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711220    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"} err="failed to get container status \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist"
Sep 07 17:11:45.711285 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711238    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.711449 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711433    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"} err="failed to get container status \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist"
Sep 07 17:11:45.711496 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711449    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.711661 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711641    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"} err="failed to get container status \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist"
Sep 07 17:11:45.711708 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711661    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.711902 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711885    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"} err="failed to get container status \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist"
Sep 07 17:11:45.711954 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.711902    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.712117 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712099    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"} err="failed to get container status \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist"
Sep 07 17:11:45.712154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712117    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.712337 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712317    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"} err="failed to get container status \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist"
Sep 07 17:11:45.712385 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712339    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.712549 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712532    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"} err="failed to get container status \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist"
Sep 07 17:11:45.712593 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712550    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.712763 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712747    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"} err="failed to get container status \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist"
Sep 07 17:11:45.712815 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712764    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.712986 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712967    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"} err="failed to get container status \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist"
Sep 07 17:11:45.713026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.712986    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.713183 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713168    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"} err="failed to get container status \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist"
Sep 07 17:11:45.713221 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713183    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.713389 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713370    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"} err="failed to get container status \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist"
Sep 07 17:11:45.713436 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713390    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.713594 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713579    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"} err="failed to get container status \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist"
Sep 07 17:11:45.713637 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713594    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.713836 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713814    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"} err="failed to get container status \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist"
Sep 07 17:11:45.713912 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.713837    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.714074 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714059    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"} err="failed to get container status \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist"
Sep 07 17:11:45.714120 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714074    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.714276 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714255    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"} err="failed to get container status \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist"
Sep 07 17:11:45.714318 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714277    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.714469 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714453    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"} err="failed to get container status \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist"
Sep 07 17:11:45.714469 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714468    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.714666 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714646    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"} err="failed to get container status \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist"
Sep 07 17:11:45.714711 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714666    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.714886 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714866    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"} err="failed to get container status \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist"
Sep 07 17:11:45.714959 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.714888    2566 scope.go:117] "RemoveContainer" containerID="a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"
Sep 07 17:11:45.715108 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715090    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007"} err="failed to get container status \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": rpc error: code = NotFound desc = could not find container \"a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007\": container with ID starting with a58290c2beb54369f6b11b54414523061f0f5da93aebca4ed59bf2ae13426007 not found: ID does not exist"
Sep 07 17:11:45.715152 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715109    2566 scope.go:117] "RemoveContainer" containerID="b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"
Sep 07 17:11:45.715306 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715287    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3"} err="failed to get container status \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": rpc error: code = NotFound desc = could not find container \"b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3\": container with ID starting with b7a211d247478cb0e42297d0b498f961268b30b624a7fd0f96aa55d695345ac3 not found: ID does not exist"
Sep 07 17:11:45.715347 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715306    2566 scope.go:117] "RemoveContainer" containerID="07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"
Sep 07 17:11:45.715502 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715487    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b"} err="failed to get container status \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": rpc error: code = NotFound desc = could not find container \"07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b\": container with ID starting with 07f08b23b99815704cfefce150191034b69cac8dd52fb659de51fedbf9a2498b not found: ID does not exist"
Sep 07 17:11:45.715502 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715501    2566 scope.go:117] "RemoveContainer" containerID="19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"
Sep 07 17:11:45.715689 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715674    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7"} err="failed to get container status \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": rpc error: code = NotFound desc = could not find container \"19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7\": container with ID starting with 19de65884c49e3328f103e32ab834f8e5e31fb796ec91d91c847c641c05be6b7 not found: ID does not exist"
Sep 07 17:11:45.715750 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715689    2566 scope.go:117] "RemoveContainer" containerID="a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"
Sep 07 17:11:45.715878 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715862    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e"} err="failed to get container status \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": rpc error: code = NotFound desc = could not find container \"a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e\": container with ID starting with a05189d5191ef0e2b7cf0fe8c3b14c20c3f9037e957edb646e6266efd022ca0e not found: ID does not exist"
Sep 07 17:11:45.715920 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.715879    2566 scope.go:117] "RemoveContainer" containerID="ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"
Sep 07 17:11:45.716079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.716055    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22"} err="failed to get container status \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": rpc error: code = NotFound desc = could not find container \"ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22\": container with ID starting with ec9617ca3f6f2ea6d8e4635e60dca7af99a78a4943e3531ddc9369858c31ed22 not found: ID does not exist"
Sep 07 17:11:45.716119 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.716080    2566 scope.go:117] "RemoveContainer" containerID="18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"
Sep 07 17:11:45.716286 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.716268    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce"} err="failed to get container status \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": rpc error: code = NotFound desc = could not find container \"18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce\": container with ID starting with 18c0cf454a2e939d5a0919721a2c43a41c7b895d71dd66fc8c28f31ba8481fce not found: ID does not exist"
Sep 07 17:11:45.739713 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.739686    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:11:45.739986 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.739972    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="init-config-reloader"
Sep 07 17:11:45.740027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.739988    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="init-config-reloader"
Sep 07 17:11:45.740027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740004    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-web"
Sep 07 17:11:45.740027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740010    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-web"
Sep 07 17:11:45.740027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740018    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy"
Sep 07 17:11:45.740027 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740023    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740031    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-thanos"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740037    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-thanos"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740044    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="thanos-sidecar"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740050    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="thanos-sidecar"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740064    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="348b2ab2-fb0b-45bf-aa1c-fefde9178500" containerName="console"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740070    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="348b2ab2-fb0b-45bf-aa1c-fefde9178500" containerName="console"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740075    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="prometheus"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740080    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="prometheus"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740086    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="config-reloader"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740091    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="config-reloader"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740139    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="348b2ab2-fb0b-45bf-aa1c-fefde9178500" containerName="console"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740146    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740152    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-thanos"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740158    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="config-reloader"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740164    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="thanos-sidecar"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740168    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="kube-rbac-proxy-web"
Sep 07 17:11:45.740179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.740174    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" containerName="prometheus"
Sep 07 17:11:45.744384 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.744369    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.747045 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747025    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 07 17:11:45.747144 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747101    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 07 17:11:45.747144 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747132    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 07 17:11:45.747413 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747398    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 07 17:11:45.747550 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747537    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 07 17:11:45.747635 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747619    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 07 17:11:45.748001 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.747987    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 17:11:45.748449 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.748429    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 07 17:11:45.748449 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.748443    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-37qub8gpb67np\""
Sep 07 17:11:45.748644 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.748429    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 07 17:11:45.748644 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.748620    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 07 17:11:45.748766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.748700    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 07 17:11:45.748766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.748757    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 07 17:11:45.749114 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.749100    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jfpb6\""
Sep 07 17:11:45.750935 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.750916    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 07 17:11:45.751555 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.751502    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 07 17:11:45.754402 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.754385    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 07 17:11:45.765487 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.765465    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:11:45.844783 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844751    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.844783 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844784    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8f5\" (UniqueName: \"kubernetes.io/projected/c36584fd-a5ea-4462-bb99-a6ec4587fab2-kube-api-access-rc8f5\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844804    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844821    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844896    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c36584fd-a5ea-4462-bb99-a6ec4587fab2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.844963    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845026 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845033    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845120    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845161    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c36584fd-a5ea-4462-bb99-a6ec4587fab2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845211    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845236    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845278    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845291 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-config\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.845595 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.845317    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.945931 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.945846    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.945931 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.945902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c36584fd-a5ea-4462-bb99-a6ec4587fab2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.945931 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.945931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946145 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.945959    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946145 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.945990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946145 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946013    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-config\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946145 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946401 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946374    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946531 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946409    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8f5\" (UniqueName: \"kubernetes.io/projected/c36584fd-a5ea-4462-bb99-a6ec4587fab2-kube-api-access-rc8f5\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946531 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946451    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946531 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946531 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946531 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946524    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c36584fd-a5ea-4462-bb99-a6ec4587fab2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946548    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946573    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946615    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946702    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.946800 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.946782    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.947190 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.947168    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.949134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.947453    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.949134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.948202    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.949134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.948337    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.949134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.948885    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.949134 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.948979    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c36584fd-a5ea-4462-bb99-a6ec4587fab2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.949458 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.949190    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.950004 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.949635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.950004 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.949963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.950154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.950098    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-config\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.950956 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.950896    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.951039 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.950951    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.951140 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.951115    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c36584fd-a5ea-4462-bb99-a6ec4587fab2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.951556 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.951531    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.951638 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.951596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c36584fd-a5ea-4462-bb99-a6ec4587fab2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.951638 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.951596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.951715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.951644    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.952456 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.952438    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c36584fd-a5ea-4462-bb99-a6ec4587fab2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:45.956422 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:45.956400    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8f5\" (UniqueName: \"kubernetes.io/projected/c36584fd-a5ea-4462-bb99-a6ec4587fab2-kube-api-access-rc8f5\") pod \"prometheus-k8s-0\" (UID: \"c36584fd-a5ea-4462-bb99-a6ec4587fab2\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:46.054672 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:46.054639    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:11:46.338174 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:46.338145    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 07 17:11:46.340849 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:11:46.340825    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36584fd_a5ea_4462_bb99_a6ec4587fab2.slice/crio-a0fccb44341a63f1b2ec102d957afa1d78966a196f43e23fa3723e88fbf04886 WatchSource:0}: Error finding container a0fccb44341a63f1b2ec102d957afa1d78966a196f43e23fa3723e88fbf04886: Status 404 returned error can't find the container with id a0fccb44341a63f1b2ec102d957afa1d78966a196f43e23fa3723e88fbf04886
Sep 07 17:11:46.664780 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:46.664679    2566 generic.go:356] "Generic (PLEG): container finished" podID="c36584fd-a5ea-4462-bb99-a6ec4587fab2" containerID="0818208aa329b7ea4ea6af5f5e8018abfe1269f896551265cf6f16a6d77f2183" exitCode=0
Sep 07 17:11:46.664780 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:46.664754    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerDied","Data":"0818208aa329b7ea4ea6af5f5e8018abfe1269f896551265cf6f16a6d77f2183"}
Sep 07 17:11:46.664947 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:46.664810    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"a0fccb44341a63f1b2ec102d957afa1d78966a196f43e23fa3723e88fbf04886"}
Sep 07 17:11:46.773385 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:46.773356    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a314891-1fa5-40e0-ae68-3d31462d04e7" path="/var/lib/kubelet/pods/9a314891-1fa5-40e0-ae68-3d31462d04e7/volumes"
Sep 07 17:11:47.671687 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.671653    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"95a9369f9e05eaf640b4b97a83ef3e65218bf5bb92b680d615e54970c6f85274"}
Sep 07 17:11:47.672180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.671774    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"916f59327c55f7e206c543906cfe6c21110b620371e0adc043fedc121645cd29"}
Sep 07 17:11:47.672180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.671804    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"0ab1365737c83f8035e1348003df69759df8c49301355d84975bca7f511dd27a"}
Sep 07 17:11:47.672180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.671828    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"790c188abe508c417c9d408bcc2af26bb4351ce11c56baac5eea3cfe5178e446"}
Sep 07 17:11:47.672180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.671851    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"0fbedf070050ee59d364d52308ed7d3fdc661a4525c9078ec7fd74f37cc1c9db"}
Sep 07 17:11:47.672180 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.671885    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c36584fd-a5ea-4462-bb99-a6ec4587fab2","Type":"ContainerStarted","Data":"1acbb0f04a1339364f16c20ad8b310d8fd159cf83741740418bff855eaad03b1"}
Sep 07 17:11:47.705629 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:47.705574    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.685955108 podStartE2EDuration="2.705558093s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.602985ms" isStatefulPod=false podCreationTimestamp="2026-09-07 17:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:11:47.705043897 +0000 UTC m=+193.441852310" watchObservedRunningTime="2026-09-07 17:11:47.705558093 +0000 UTC m=+193.442366507"
Sep 07 17:11:51.055367 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:11:51.055331    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:12:46.055440 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:12:46.055401    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:12:46.071262 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:12:46.071234    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:12:46.903472 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:12:46.903445    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 07 17:13:34.681775 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:13:34.681721    2566 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 17:21:58.013996 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.013918    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-7dkh8"]
Sep 07 17:21:58.016181 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.016164    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:21:58.020883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.020861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 07 17:21:58.021094 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.021077    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 07 17:21:58.023711 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.023693    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-dwfc2\""
Sep 07 17:21:58.023797 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.023714    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 07 17:21:58.027275 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.027253    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-7dkh8"]
Sep 07 17:21:58.109174 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.109141    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbj8\" (UniqueName: \"kubernetes.io/projected/bca3497d-591a-40f4-8750-58f81366d801-kube-api-access-rhbj8\") pod \"feast-test-apply-7dkh8\" (UID: \"bca3497d-591a-40f4-8750-58f81366d801\") " pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:21:58.210346 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.210313    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbj8\" (UniqueName: \"kubernetes.io/projected/bca3497d-591a-40f4-8750-58f81366d801-kube-api-access-rhbj8\") pod \"feast-test-apply-7dkh8\" (UID: \"bca3497d-591a-40f4-8750-58f81366d801\") " pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:21:58.223768 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.223719    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbj8\" (UniqueName: \"kubernetes.io/projected/bca3497d-591a-40f4-8750-58f81366d801-kube-api-access-rhbj8\") pod \"feast-test-apply-7dkh8\" (UID: \"bca3497d-591a-40f4-8750-58f81366d801\") " pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:21:58.332600 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.332577    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:21:58.600483 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.600454    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-7dkh8"]
Sep 07 17:21:58.602328 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:21:58.602295    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbca3497d_591a_40f4_8750_58f81366d801.slice/crio-26f0bf2adc0e36e681a12959b433e73826b69b81793e43838ed7374fe2e49c71 WatchSource:0}: Error finding container 26f0bf2adc0e36e681a12959b433e73826b69b81793e43838ed7374fe2e49c71: Status 404 returned error can't find the container with id 26f0bf2adc0e36e681a12959b433e73826b69b81793e43838ed7374fe2e49c71
Sep 07 17:21:58.604195 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.604177    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:21:58.875548 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:21:58.875468    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7dkh8" event={"ID":"bca3497d-591a-40f4-8750-58f81366d801","Type":"ContainerStarted","Data":"26f0bf2adc0e36e681a12959b433e73826b69b81793e43838ed7374fe2e49c71"}
Sep 07 17:22:03.898189 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:03.898150    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7dkh8" event={"ID":"bca3497d-591a-40f4-8750-58f81366d801","Type":"ContainerStarted","Data":"f40fd3e150b3c2510b7b0737e4835c8519595dadcd69eea101fee975852709d9"}
Sep 07 17:22:09.920501 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:09.920469    2566 generic.go:356] "Generic (PLEG): container finished" podID="bca3497d-591a-40f4-8750-58f81366d801" containerID="f40fd3e150b3c2510b7b0737e4835c8519595dadcd69eea101fee975852709d9" exitCode=0
Sep 07 17:22:09.920890 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:09.920548    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7dkh8" event={"ID":"bca3497d-591a-40f4-8750-58f81366d801","Type":"ContainerDied","Data":"f40fd3e150b3c2510b7b0737e4835c8519595dadcd69eea101fee975852709d9"}
Sep 07 17:22:10.926702 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:10.926663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7dkh8" event={"ID":"bca3497d-591a-40f4-8750-58f81366d801","Type":"ContainerStarted","Data":"08f41b0d7a07e188af7f583b7caea652b7679dc33f0ecdb7241f60e67e1bc978"}
Sep 07 17:22:10.947957 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:10.947909    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-7dkh8" podStartSLOduration=2.72784409 podStartE2EDuration="13.947892268s" totalImagesPullingTime="4.741446774s" totalInitContainerRuntime="6.478601404s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:22:10.947061535 +0000 UTC m=+816.683869949" watchObservedRunningTime="2026-09-07 17:22:10.947892268 +0000 UTC m=+816.684700721"
Sep 07 17:22:19.960150 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:19.960112    2566 generic.go:356] "Generic (PLEG): container finished" podID="bca3497d-591a-40f4-8750-58f81366d801" containerID="08f41b0d7a07e188af7f583b7caea652b7679dc33f0ecdb7241f60e67e1bc978" exitCode=0
Sep 07 17:22:19.960572 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:19.960169    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7dkh8" event={"ID":"bca3497d-591a-40f4-8750-58f81366d801","Type":"ContainerDied","Data":"08f41b0d7a07e188af7f583b7caea652b7679dc33f0ecdb7241f60e67e1bc978"}
Sep 07 17:22:21.164140 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.164105    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:22:21.298454 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.298369    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhbj8\" (UniqueName: \"kubernetes.io/projected/bca3497d-591a-40f4-8750-58f81366d801-kube-api-access-rhbj8\") pod \"bca3497d-591a-40f4-8750-58f81366d801\" (UID: \"bca3497d-591a-40f4-8750-58f81366d801\") "
Sep 07 17:22:21.300560 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.300531    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca3497d-591a-40f4-8750-58f81366d801-kube-api-access-rhbj8" (OuterVolumeSpecName: "kube-api-access-rhbj8") pod "bca3497d-591a-40f4-8750-58f81366d801" (UID: "bca3497d-591a-40f4-8750-58f81366d801"). InnerVolumeSpecName "kube-api-access-rhbj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:22:21.399046 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.399011    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhbj8\" (UniqueName: \"kubernetes.io/projected/bca3497d-591a-40f4-8750-58f81366d801-kube-api-access-rhbj8\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:22:21.968778 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.968723    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-7dkh8" event={"ID":"bca3497d-591a-40f4-8750-58f81366d801","Type":"ContainerDied","Data":"26f0bf2adc0e36e681a12959b433e73826b69b81793e43838ed7374fe2e49c71"}
Sep 07 17:22:21.968778 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.968759    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-7dkh8"
Sep 07 17:22:21.968778 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:21.968779    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26f0bf2adc0e36e681a12959b433e73826b69b81793e43838ed7374fe2e49c71"
Sep 07 17:22:22.152818 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:22.152786    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-7dkh8_bca3497d-591a-40f4-8750-58f81366d801/feast-0/0.log"
Sep 07 17:22:22.159029 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:22.159007    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-7dkh8_bca3497d-591a-40f4-8750-58f81366d801/feast-1/0.log"
Sep 07 17:22:59.455656 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:59.455610    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-7dkh8"]
Sep 07 17:22:59.460779 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:22:59.460750    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-7dkh8"]
Sep 07 17:23:00.772074 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:23:00.772034    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bca3497d-591a-40f4-8750-58f81366d801" path="/var/lib/kubelet/pods/bca3497d-591a-40f4-8750-58f81366d801/volumes"
Sep 07 17:28:31.646954 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.646917    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"]
Sep 07 17:28:31.647345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.647238    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca3497d-591a-40f4-8750-58f81366d801" containerName="feast-0"
Sep 07 17:28:31.647345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.647250    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca3497d-591a-40f4-8750-58f81366d801" containerName="feast-0"
Sep 07 17:28:31.647345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.647259    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca3497d-591a-40f4-8750-58f81366d801" containerName="feast-1"
Sep 07 17:28:31.647345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.647264    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca3497d-591a-40f4-8750-58f81366d801" containerName="feast-1"
Sep 07 17:28:31.647345 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.647318    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca3497d-591a-40f4-8750-58f81366d801" containerName="feast-1"
Sep 07 17:28:31.650725 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.650709    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.653348 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.653321    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 07 17:28:31.653348 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.653342    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 07 17:28:31.653519 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.653324    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 07 17:28:31.653606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.653592    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 07 17:28:31.653879 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.653862    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-x88zn\""
Sep 07 17:28:31.654450 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.654434    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 07 17:28:31.654524 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.654469    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 07 17:28:31.664015 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.663996    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"]
Sep 07 17:28:31.833503 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.833465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.833503 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.833504    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ded1bd-990d-42ae-8d4a-3faa73842003-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.833715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.833522    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.833715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.833622    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.833715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.833658    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzlzz\" (UniqueName: \"kubernetes.io/projected/c0ded1bd-990d-42ae-8d4a-3faa73842003-kube-api-access-hzlzz\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.833715 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.833706    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.934853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.934776    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.934853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.934814    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzlzz\" (UniqueName: \"kubernetes.io/projected/c0ded1bd-990d-42ae-8d4a-3faa73842003-kube-api-access-hzlzz\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.934860    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.934892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.934918    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ded1bd-990d-42ae-8d4a-3faa73842003-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:28:31.934922    2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.934941    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:28:31.934989    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls podName:c0ded1bd-990d-42ae-8d4a-3faa73842003 nodeName:}" failed. No retries permitted until 2026-09-07 17:28:32.434969823 +0000 UTC m=+1198.171778213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls") pod "feast-simple-feast-setup-57576b8fcf-6qbhs" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003") : secret "feast-simple-feast-setup-online-tls" not found
Sep 07 17:28:31.935035 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:28:31.935021    2566 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 07 17:28:31.935387 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:28:31.935082    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls podName:c0ded1bd-990d-42ae-8d4a-3faa73842003 nodeName:}" failed. No retries permitted until 2026-09-07 17:28:32.435067413 +0000 UTC m=+1198.171875809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-6qbhs" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 07 17:28:31.935387 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.935317    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ded1bd-990d-42ae-8d4a-3faa73842003-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.937360 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.937336    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.937479 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.937347    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:31.949929 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:31.949901    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzlzz\" (UniqueName: \"kubernetes.io/projected/c0ded1bd-990d-42ae-8d4a-3faa73842003-kube-api-access-hzlzz\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:32.438244 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.438197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:32.438432 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.438291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:32.440648 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.440618    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:32.440648 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.440637    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-6qbhs\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:32.573676 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.573642    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:32.853348 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.853283    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"]
Sep 07 17:28:32.855915 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:28:32.855884    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0ded1bd_990d_42ae_8d4a_3faa73842003.slice/crio-f76131bae68d20bab68712fea8aded2845ace3f372f2be95cdce7652d8fc0c87 WatchSource:0}: Error finding container f76131bae68d20bab68712fea8aded2845ace3f372f2be95cdce7652d8fc0c87: Status 404 returned error can't find the container with id f76131bae68d20bab68712fea8aded2845ace3f372f2be95cdce7652d8fc0c87
Sep 07 17:28:32.857639 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:32.857622    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 17:28:33.307477 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:33.307404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"f76131bae68d20bab68712fea8aded2845ace3f372f2be95cdce7652d8fc0c87"}
Sep 07 17:28:34.769752 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:34.769695    2566 scope.go:117] "RemoveContainer" containerID="08f41b0d7a07e188af7f583b7caea652b7679dc33f0ecdb7241f60e67e1bc978"
Sep 07 17:28:35.252760 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:35.252669    2566 scope.go:117] "RemoveContainer" containerID="f40fd3e150b3c2510b7b0737e4835c8519595dadcd69eea101fee975852709d9"
Sep 07 17:28:46.374480 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:46.374444    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"}
Sep 07 17:28:51.398870 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:51.398839    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerID="11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e" exitCode=0
Sep 07 17:28:51.399229 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:51.398918    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"}
Sep 07 17:28:52.405061 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:52.405027    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"}
Sep 07 17:28:57.427379 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:57.427343    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerID="7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc" exitCode=0
Sep 07 17:28:57.427789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:57.427401    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"}
Sep 07 17:28:58.437311 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:58.437271    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"}
Sep 07 17:28:58.437798 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:58.437333    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"}
Sep 07 17:28:58.437798 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:58.437353    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"}
Sep 07 17:28:58.437798 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:58.437372    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerStarted","Data":"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"}
Sep 07 17:28:58.465076 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:58.464996    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podStartSLOduration=14.244627634 podStartE2EDuration="27.464969915s" totalImagesPullingTime="13.220342281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:28:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:28:58.462954271 +0000 UTC m=+1224.199762777" watchObservedRunningTime="2026-09-07 17:28:58.464969915 +0000 UTC m=+1224.201778328"
Sep 07 17:28:59.574664 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.574626    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:59.575267 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.575240    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:59.575267 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.575278    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:59.575459 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.575297    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:28:59.577028 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.576987    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused"
Sep 07 17:28:59.577219 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.577011    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.19:6571: connect: connection refused"
Sep 07 17:28:59.577302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.577012    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.19:8816: connect: connection refused"
Sep 07 17:28:59.577302 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:28:59.577080    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused"
Sep 07 17:29:02.574003 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.573942    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:02.574495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574044    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:02.574495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574068    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:02.574495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574174    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused"
Sep 07 17:29:02.574495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574304    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.19:6571: connect: connection refused"
Sep 07 17:29:02.574495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574374    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.19:8816: connect: connection refused"
Sep 07 17:29:02.574816 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574631    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:02.574816 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:02.574644    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused"
Sep 07 17:29:05.574945 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:05.574904    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused"
Sep 07 17:29:05.575554 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:05.575399    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:05.575797 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:05.575774    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:05.576339 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:05.576318    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:05.576438 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:05.576390    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:05.581174 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:05.581150    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:06.482873 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:06.482835    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:08.574996 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:08.574962    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:29:09.490446 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:29:09.490420    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:30:11.958453 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:11.958412    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"]
Sep 07 17:30:11.958994 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:11.958686    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="registry" containerID="cri-o://87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536" gracePeriod=30
Sep 07 17:30:11.958994 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:11.958719    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="offline" containerID="cri-o://50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856" gracePeriod=30
Sep 07 17:30:11.958994 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:11.958719    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" containerID="cri-o://f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b" gracePeriod=30
Sep 07 17:30:11.958994 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:11.958780    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online" containerID="cri-o://9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879" gracePeriod=30
Sep 07 17:30:12.414766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.414711    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"]
Sep 07 17:30:12.419307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.419284    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.422492 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.422466    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gjsd2\""
Sep 07 17:30:12.431087 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.431057    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"]
Sep 07 17:30:12.551972 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.551932    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w44z\" (UniqueName: \"kubernetes.io/projected/ce370b8c-4f3e-48c9-889b-258611ec8722-kube-api-access-4w44z\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.551972 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.551984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.552298 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.552076    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.552298 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.552118    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.552298 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.552160    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce370b8c-4f3e-48c9-889b-258611ec8722-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.552298 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.552189    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653189 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653142    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w44z\" (UniqueName: \"kubernetes.io/projected/ce370b8c-4f3e-48c9-889b-258611ec8722-kube-api-access-4w44z\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653390 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653198    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653390 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653390 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653257    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653390 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce370b8c-4f3e-48c9-889b-258611ec8722-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653390 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.653773 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.653727    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce370b8c-4f3e-48c9-889b-258611ec8722-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.655990 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.655958    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.655990 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.655971    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.656218 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.656196    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.656266 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.656235    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.663488 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.663465    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w44z\" (UniqueName: \"kubernetes.io/projected/ce370b8c-4f3e-48c9-889b-258611ec8722-kube-api-access-4w44z\") pod \"feast-simple-feast-setup-57576b8fcf-lr6mx\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.729229 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.729132    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:12.747044 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.747017    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerID="f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b" exitCode=0
Sep 07 17:30:12.747167 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:12.747086    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"}
Sep 07 17:30:13.012808 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:13.012406    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"]
Sep 07 17:30:13.015040 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:30:13.015008    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce370b8c_4f3e_48c9_889b_258611ec8722.slice/crio-dcf88c1ad1f5213a7790f77597eff417f88be3cd08c2bd0bb649a2fc49c9c5dd WatchSource:0}: Error finding container dcf88c1ad1f5213a7790f77597eff417f88be3cd08c2bd0bb649a2fc49c9c5dd: Status 404 returned error can't find the container with id dcf88c1ad1f5213a7790f77597eff417f88be3cd08c2bd0bb649a2fc49c9c5dd
Sep 07 17:30:13.760272 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:13.760234    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerID="9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879" exitCode=0
Sep 07 17:30:13.760431 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:13.760309    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"}
Sep 07 17:30:13.761979 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:13.761948    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"}
Sep 07 17:30:13.762086 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:13.761988    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"dcf88c1ad1f5213a7790f77597eff417f88be3cd08c2bd0bb649a2fc49c9c5dd"}
Sep 07 17:30:16.480252 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:16.480209    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused"
Sep 07 17:30:18.782290 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:18.782255    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerID="ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333" exitCode=0
Sep 07 17:30:18.782651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:18.782326    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"}
Sep 07 17:30:19.490906 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:19.490852    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused"
Sep 07 17:30:19.788064 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:19.787968    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"}
Sep 07 17:30:24.808569 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:24.808536    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerID="81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9" exitCode=0
Sep 07 17:30:24.808957 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:24.808605    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"}
Sep 07 17:30:25.818545 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:25.818502    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"}
Sep 07 17:30:25.819055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:25.818563    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"}
Sep 07 17:30:25.819055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:25.818587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"}
Sep 07 17:30:25.819055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:25.818604    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerStarted","Data":"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"}
Sep 07 17:30:25.847790 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:25.847700    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podStartSLOduration=13.847677825 podStartE2EDuration="13.847677825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:30:25.844536587 +0000 UTC m=+1311.581345028" watchObservedRunningTime="2026-09-07 17:30:25.847677825 +0000 UTC m=+1311.584486244"
Sep 07 17:30:26.480923 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:26.480859    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused"
Sep 07 17:30:27.730061 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.730014    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:27.730550 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.730092    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:27.730550 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.730116    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:27.730550 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.730136    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:27.732363 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.732307    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused"
Sep 07 17:30:27.732363 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.732337    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused"
Sep 07 17:30:27.732570 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.732371    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused"
Sep 07 17:30:27.732570 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:27.732455    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused"
Sep 07 17:30:29.490123 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:29.490069    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused"
Sep 07 17:30:30.729780 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:30.729710    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused"
Sep 07 17:30:30.730382 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:30.729759    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused"
Sep 07 17:30:30.730475 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:30.729767    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused"
Sep 07 17:30:30.730475 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:30.729785    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused"
Sep 07 17:30:32.730053 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:32.730010    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:32.730411 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:32.730078    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:32.730411 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:32.730094    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:32.730411 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:32.730168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.730975 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.730944    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.731373 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.731064    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.731373 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.731264    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.735911 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.735893    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.862995 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.862964    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.863187 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.863172    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.863242 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.863229    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:33.865720 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:33.865704    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:30:36.480434 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:36.480392    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online" probeResult="failure" output="Get \"https://10.134.0.19:6567/health\": dial tcp 10.134.0.19:6567: connect: connection refused"
Sep 07 17:30:36.480833 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:36.480519    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:30:39.490578 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:39.490529    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.19:8443: connect: connection refused"
Sep 07 17:30:39.491018 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:39.490681    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:30:42.590605 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.590581    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:30:42.706102 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706070    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzlzz\" (UniqueName: \"kubernetes.io/projected/c0ded1bd-990d-42ae-8d4a-3faa73842003-kube-api-access-hzlzz\") pod \"c0ded1bd-990d-42ae-8d4a-3faa73842003\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") "
Sep 07 17:30:42.706102 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706104    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls\") pod \"c0ded1bd-990d-42ae-8d4a-3faa73842003\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") "
Sep 07 17:30:42.706341 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706131    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ded1bd-990d-42ae-8d4a-3faa73842003-feast-data\") pod \"c0ded1bd-990d-42ae-8d4a-3faa73842003\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") "
Sep 07 17:30:42.706341 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706146    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls\") pod \"c0ded1bd-990d-42ae-8d4a-3faa73842003\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") "
Sep 07 17:30:42.706341 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706165    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-offline-tls\") pod \"c0ded1bd-990d-42ae-8d4a-3faa73842003\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") "
Sep 07 17:30:42.706341 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706183    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-registry-tls\") pod \"c0ded1bd-990d-42ae-8d4a-3faa73842003\" (UID: \"c0ded1bd-990d-42ae-8d4a-3faa73842003\") "
Sep 07 17:30:42.706688 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.706662    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0ded1bd-990d-42ae-8d4a-3faa73842003-feast-data" (OuterVolumeSpecName: "feast-data") pod "c0ded1bd-990d-42ae-8d4a-3faa73842003" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:30:42.708481 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.708445    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c0ded1bd-990d-42ae-8d4a-3faa73842003" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:30:42.708790 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.708761    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c0ded1bd-990d-42ae-8d4a-3faa73842003" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:30:42.708790 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.708780    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls" (OuterVolumeSpecName: "online-tls") pod "c0ded1bd-990d-42ae-8d4a-3faa73842003" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:30:42.708895 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.708835    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c0ded1bd-990d-42ae-8d4a-3faa73842003" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:30:42.708895 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.708845    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0ded1bd-990d-42ae-8d4a-3faa73842003-kube-api-access-hzlzz" (OuterVolumeSpecName: "kube-api-access-hzlzz") pod "c0ded1bd-990d-42ae-8d4a-3faa73842003" (UID: "c0ded1bd-990d-42ae-8d4a-3faa73842003"). InnerVolumeSpecName "kube-api-access-hzlzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:30:42.807702 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.807674    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzlzz\" (UniqueName: \"kubernetes.io/projected/c0ded1bd-990d-42ae-8d4a-3faa73842003-kube-api-access-hzlzz\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:30:42.807702 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.807698    2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-ui-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:30:42.807866 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.807708    2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c0ded1bd-990d-42ae-8d4a-3faa73842003-feast-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:30:42.807866 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.807716    2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-online-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:30:42.807866 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.807724    2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-offline-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:30:42.807866 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.807748    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c0ded1bd-990d-42ae-8d4a-3faa73842003-registry-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:30:42.904870 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.904839    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerID="50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856" exitCode=137
Sep 07 17:30:42.904870 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.904866    2566 generic.go:356] "Generic (PLEG): container finished" podID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerID="87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536" exitCode=137
Sep 07 17:30:42.905057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.904908    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"
Sep 07 17:30:42.905057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.904925    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"}
Sep 07 17:30:42.905057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.904986    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"}
Sep 07 17:30:42.905057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.905001    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs" event={"ID":"c0ded1bd-990d-42ae-8d4a-3faa73842003","Type":"ContainerDied","Data":"f76131bae68d20bab68712fea8aded2845ace3f372f2be95cdce7652d8fc0c87"}
Sep 07 17:30:42.905057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.905020    2566 scope.go:117] "RemoveContainer" containerID="f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"
Sep 07 17:30:42.913088 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.913070    2566 scope.go:117] "RemoveContainer" containerID="50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"
Sep 07 17:30:42.920584 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.920568    2566 scope.go:117] "RemoveContainer" containerID="9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"
Sep 07 17:30:42.925167 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.925148    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"]
Sep 07 17:30:42.928421 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.928064    2566 scope.go:117] "RemoveContainer" containerID="87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"
Sep 07 17:30:42.929341 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.929325    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-6qbhs"]
Sep 07 17:30:42.935384 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.935364    2566 scope.go:117] "RemoveContainer" containerID="7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"
Sep 07 17:30:42.942249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.942232    2566 scope.go:117] "RemoveContainer" containerID="11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"
Sep 07 17:30:42.949109 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949090    2566 scope.go:117] "RemoveContainer" containerID="f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"
Sep 07 17:30:42.949411 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:30:42.949393    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b\": container with ID starting with f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b not found: ID does not exist" containerID="f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"
Sep 07 17:30:42.949472 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949419    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"} err="failed to get container status \"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b\": rpc error: code = NotFound desc = could not find container \"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b\": container with ID starting with f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b not found: ID does not exist"
Sep 07 17:30:42.949472 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949435    2566 scope.go:117] "RemoveContainer" containerID="50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"
Sep 07 17:30:42.949668 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:30:42.949652    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856\": container with ID starting with 50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856 not found: ID does not exist" containerID="50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"
Sep 07 17:30:42.949724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949673    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"} err="failed to get container status \"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856\": rpc error: code = NotFound desc = could not find container \"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856\": container with ID starting with 50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856 not found: ID does not exist"
Sep 07 17:30:42.949724 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949687    2566 scope.go:117] "RemoveContainer" containerID="9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"
Sep 07 17:30:42.949954 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:30:42.949937    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879\": container with ID starting with 9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879 not found: ID does not exist" containerID="9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"
Sep 07 17:30:42.949998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949958    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"} err="failed to get container status \"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879\": rpc error: code = NotFound desc = could not find container \"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879\": container with ID starting with 9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879 not found: ID does not exist"
Sep 07 17:30:42.949998 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.949971    2566 scope.go:117] "RemoveContainer" containerID="87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"
Sep 07 17:30:42.950201 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:30:42.950181    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536\": container with ID starting with 87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536 not found: ID does not exist" containerID="87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"
Sep 07 17:30:42.950260 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950210    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"} err="failed to get container status \"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536\": rpc error: code = NotFound desc = could not find container \"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536\": container with ID starting with 87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536 not found: ID does not exist"
Sep 07 17:30:42.950260 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950233    2566 scope.go:117] "RemoveContainer" containerID="7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"
Sep 07 17:30:42.950489 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:30:42.950473    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc\": container with ID starting with 7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc not found: ID does not exist" containerID="7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"
Sep 07 17:30:42.950575 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950489    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"} err="failed to get container status \"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc\": rpc error: code = NotFound desc = could not find container \"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc\": container with ID starting with 7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc not found: ID does not exist"
Sep 07 17:30:42.950575 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950509    2566 scope.go:117] "RemoveContainer" containerID="11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"
Sep 07 17:30:42.950833 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:30:42.950705    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e\": container with ID starting with 11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e not found: ID does not exist" containerID="11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"
Sep 07 17:30:42.950833 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950774    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"} err="failed to get container status \"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e\": rpc error: code = NotFound desc = could not find container \"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e\": container with ID starting with 11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e not found: ID does not exist"
Sep 07 17:30:42.950833 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950788    2566 scope.go:117] "RemoveContainer" containerID="f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"
Sep 07 17:30:42.951008 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.950991    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b"} err="failed to get container status \"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b\": rpc error: code = NotFound desc = could not find container \"f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b\": container with ID starting with f8620ad547951cb93ae28a8bf7483b8c27447f59ab9819e9ef30f1d7ff6a6a9b not found: ID does not exist"
Sep 07 17:30:42.951048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951008    2566 scope.go:117] "RemoveContainer" containerID="50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"
Sep 07 17:30:42.951218 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951201    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856"} err="failed to get container status \"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856\": rpc error: code = NotFound desc = could not find container \"50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856\": container with ID starting with 50247a842e841f73311560ef2705cb4da00e82d0558ed34b323b35510421f856 not found: ID does not exist"
Sep 07 17:30:42.951218 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951216    2566 scope.go:117] "RemoveContainer" containerID="9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"
Sep 07 17:30:42.951455 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951438    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879"} err="failed to get container status \"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879\": rpc error: code = NotFound desc = could not find container \"9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879\": container with ID starting with 9bbfcd69691e3903afe4c78d77b9a8cd9900023379b4c936a7d65ec349132879 not found: ID does not exist"
Sep 07 17:30:42.951455 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951454    2566 scope.go:117] "RemoveContainer" containerID="87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"
Sep 07 17:30:42.951678 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951657    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536"} err="failed to get container status \"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536\": rpc error: code = NotFound desc = could not find container \"87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536\": container with ID starting with 87e30137afa5d5d38c8ff81418865dcf46643543ee16533f8e5515af180ba536 not found: ID does not exist"
Sep 07 17:30:42.951765 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951680    2566 scope.go:117] "RemoveContainer" containerID="7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"
Sep 07 17:30:42.951931 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951912    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc"} err="failed to get container status \"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc\": rpc error: code = NotFound desc = could not find container \"7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc\": container with ID starting with 7f944d0735e3a852be478be336031c3146cbcc43409674638fb65cc5f7a6afcc not found: ID does not exist"
Sep 07 17:30:42.952002 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.951932    2566 scope.go:117] "RemoveContainer" containerID="11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"
Sep 07 17:30:42.952192 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:42.952174    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e"} err="failed to get container status \"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e\": rpc error: code = NotFound desc = could not find container \"11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e\": container with ID starting with 11344bd5754569c30dc6b8f837bd95454850a1b5e0ad926621e0af4aaca5688e not found: ID does not exist"
Sep 07 17:30:44.771375 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:30:44.771339    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" path="/var/lib/kubelet/pods/c0ded1bd-990d-42ae-8d4a-3faa73842003/volumes"
Sep 07 17:31:37.541199 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541159    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"]
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541574    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="feast-apply"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541593    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="feast-apply"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541606    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541615    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541629    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="offline"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541638    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="offline"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541661    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="registry"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541669    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="registry"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541678    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online"
Sep 07 17:31:37.541682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541686    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online"
Sep 07 17:31:37.542227 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541705    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="feast-init"
Sep 07 17:31:37.542227 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541714    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="feast-init"
Sep 07 17:31:37.542227 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541819    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="offline"
Sep 07 17:31:37.542227 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541832    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="registry"
Sep 07 17:31:37.542227 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541843    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="online"
Sep 07 17:31:37.542227 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.541852    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ded1bd-990d-42ae-8d4a-3faa73842003" containerName="ui"
Sep 07 17:31:37.546097 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.546076    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.549175 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.549153    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 07 17:31:37.549634 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.549614    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 07 17:31:37.550029 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.550011    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 07 17:31:37.550523 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.550502    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 07 17:31:37.550523 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.550525    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 07 17:31:37.550523 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.550537    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mpxs2\""
Sep 07 17:31:37.550773 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.550528    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 07 17:31:37.559906 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.559879    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"]
Sep 07 17:31:37.638897 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.638861    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.639079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.638910    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.639079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.638930    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8758f859-48b6-4ab8-83b1-318b99eecaa0-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.639079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.638954    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8758f859-48b6-4ab8-83b1-318b99eecaa0-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.639079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.638981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxx97\" (UniqueName: \"kubernetes.io/projected/8758f859-48b6-4ab8-83b1-318b99eecaa0-kube-api-access-dxx97\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.639079 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.639008    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740061 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740242 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740080    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740242 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8758f859-48b6-4ab8-83b1-318b99eecaa0-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740242 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8758f859-48b6-4ab8-83b1-318b99eecaa0-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740253    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxx97\" (UniqueName: \"kubernetes.io/projected/8758f859-48b6-4ab8-83b1-318b99eecaa0-kube-api-access-dxx97\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740289    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740499 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740458    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8758f859-48b6-4ab8-83b1-318b99eecaa0-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.740910 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.740888    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8758f859-48b6-4ab8-83b1-318b99eecaa0-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.742698 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.742679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.742820 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.742706    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.742820 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.742810    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.750803 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.750782    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxx97\" (UniqueName: \"kubernetes.io/projected/8758f859-48b6-4ab8-83b1-318b99eecaa0-kube-api-access-dxx97\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-89wrq\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:37.855748 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:37.855702    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:31:38.137940 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:38.137916    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"]
Sep 07 17:31:38.140045 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:31:38.140018    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8758f859_48b6_4ab8_83b1_318b99eecaa0.slice/crio-d1fce358006a516cc0f767f830cf60c654d2360123745ce804074963d47412a1 WatchSource:0}: Error finding container d1fce358006a516cc0f767f830cf60c654d2360123745ce804074963d47412a1: Status 404 returned error can't find the container with id d1fce358006a516cc0f767f830cf60c654d2360123745ce804074963d47412a1
Sep 07 17:31:39.117215 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:39.117180    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerStarted","Data":"387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10"}
Sep 07 17:31:39.117592 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:39.117229    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerStarted","Data":"d1fce358006a516cc0f767f830cf60c654d2360123745ce804074963d47412a1"}
Sep 07 17:31:43.134286 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:43.134241    2566 generic.go:356] "Generic (PLEG): container finished" podID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerID="387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10" exitCode=0
Sep 07 17:31:43.134704 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:43.134314    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerDied","Data":"387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10"}
Sep 07 17:31:44.141032 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:31:44.141000    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerStarted","Data":"b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958"}
Sep 07 17:32:05.221534 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:05.221502    2566 generic.go:356] "Generic (PLEG): container finished" podID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerID="b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958" exitCode=0
Sep 07 17:32:05.221986 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:05.221550    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerDied","Data":"b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958"}
Sep 07 17:32:06.230219 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:06.230168    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerStarted","Data":"37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183"}
Sep 07 17:32:06.230692 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:06.230236    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerStarted","Data":"183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525"}
Sep 07 17:32:06.230692 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:06.230258    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerStarted","Data":"a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871"}
Sep 07 17:32:06.256770 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:06.256657    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podStartSLOduration=29.256635428 podStartE2EDuration="29.256635428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:32:06.2546586 +0000 UTC m=+1411.991467016" watchObservedRunningTime="2026-09-07 17:32:06.256635428 +0000 UTC m=+1411.993443841"
Sep 07 17:32:07.856136 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.856055    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:07.856136 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.856122    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:07.856606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.856264    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:07.856606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.856293    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:07.856606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.856311    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:07.856606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.856327    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:07.858160 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.858131    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Sep 07 17:32:07.858247 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.858173    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused"
Sep 07 17:32:07.858247 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:07.858201    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Sep 07 17:32:10.856716 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:10.856661    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused"
Sep 07 17:32:10.857184 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:10.856672    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Sep 07 17:32:10.857184 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:10.856675    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Sep 07 17:32:13.857025 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:13.856988    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:13.857511 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:13.857112    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:13.857646 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:13.857623    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:13.857925 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:13.857901    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:14.856568 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:14.856526    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:32:17.647396 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:17.647367    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:18.326440 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:18.326405    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:32:18.859883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:18.859835    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:32:38.859934 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:38.859840    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:32:58.860884 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:32:58.860832    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:33:18.859873 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:18.859829    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:33:19.838978 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:19.838937    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"]
Sep 07 17:33:19.839179 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:19.839148    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" containerID="cri-o://a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871" gracePeriod=30
Sep 07 17:33:19.839318 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:19.839218    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="offline" containerID="cri-o://183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525" gracePeriod=30
Sep 07 17:33:19.839996 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:19.839877    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui" containerID="cri-o://37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183" gracePeriod=30
Sep 07 17:33:20.006384 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:20.006350    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"]
Sep 07 17:33:20.006853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:20.006648    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="registry" containerID="cri-o://fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355" gracePeriod=30
Sep 07 17:33:20.006853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:20.006758    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online" containerID="cri-o://b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f" gracePeriod=30
Sep 07 17:33:20.006853 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:20.006807    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="offline" containerID="cri-o://da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87" gracePeriod=30
Sep 07 17:33:20.007024 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:20.006945    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui" containerID="cri-o://5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f" gracePeriod=30
Sep 07 17:33:21.535399 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.535361    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerID="5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f" exitCode=0
Sep 07 17:33:21.535399 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.535388    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerID="b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f" exitCode=0
Sep 07 17:33:21.535875 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.535429    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"}
Sep 07 17:33:21.535875 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.535469    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"}
Sep 07 17:33:21.538069 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.538050    2566 generic.go:356] "Generic (PLEG): container finished" podID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerID="37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183" exitCode=0
Sep 07 17:33:21.538069 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.538066    2566 generic.go:356] "Generic (PLEG): container finished" podID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerID="a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871" exitCode=0
Sep 07 17:33:21.538239 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.538123    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerDied","Data":"37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183"}
Sep 07 17:33:21.538239 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:21.538164    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerDied","Data":"a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871"}
Sep 07 17:33:23.858269 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:23.858229    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Sep 07 17:33:23.862653 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:23.862588    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused"
Sep 07 17:33:23.862653 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:23.862638    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused"
Sep 07 17:33:27.648561 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:27.648516    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Sep 07 17:33:33.858326 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:33.858278    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Sep 07 17:33:33.862643 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:33.862600    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused"
Sep 07 17:33:33.862780 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:33.862600    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused"
Sep 07 17:33:37.648703 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:37.648663    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Sep 07 17:33:43.858220 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:43.858168    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Sep 07 17:33:43.858630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:43.858339    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:33:43.862768 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:43.862713    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused"
Sep 07 17:33:43.862920 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:43.862862    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused"
Sep 07 17:33:43.862920 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:43.862914    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:33:43.863047 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:43.863034    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:33:47.648448 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:47.648405    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Sep 07 17:33:47.648914 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:47.648511    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:33:50.493648 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.493623    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:33:50.635197 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635118    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8758f859-48b6-4ab8-83b1-318b99eecaa0-registry-tls\") pod \"8758f859-48b6-4ab8-83b1-318b99eecaa0\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") "
Sep 07 17:33:50.635197 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635155    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-ui-tls\") pod \"8758f859-48b6-4ab8-83b1-318b99eecaa0\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") "
Sep 07 17:33:50.635197 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635188    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxx97\" (UniqueName: \"kubernetes.io/projected/8758f859-48b6-4ab8-83b1-318b99eecaa0-kube-api-access-dxx97\") pod \"8758f859-48b6-4ab8-83b1-318b99eecaa0\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") "
Sep 07 17:33:50.635457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635208    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8758f859-48b6-4ab8-83b1-318b99eecaa0-feast-data\") pod \"8758f859-48b6-4ab8-83b1-318b99eecaa0\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") "
Sep 07 17:33:50.635457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635254    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-offline-tls\") pod \"8758f859-48b6-4ab8-83b1-318b99eecaa0\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") "
Sep 07 17:33:50.635457 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635280    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-online-tls\") pod \"8758f859-48b6-4ab8-83b1-318b99eecaa0\" (UID: \"8758f859-48b6-4ab8-83b1-318b99eecaa0\") "
Sep 07 17:33:50.635833 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635798    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8758f859-48b6-4ab8-83b1-318b99eecaa0-feast-data" (OuterVolumeSpecName: "feast-data") pod "8758f859-48b6-4ab8-83b1-318b99eecaa0" (UID: "8758f859-48b6-4ab8-83b1-318b99eecaa0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:33:50.635960 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.635843    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8758f859-48b6-4ab8-83b1-318b99eecaa0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8758f859-48b6-4ab8-83b1-318b99eecaa0" (UID: "8758f859-48b6-4ab8-83b1-318b99eecaa0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:33:50.637979 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.637954    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8758f859-48b6-4ab8-83b1-318b99eecaa0-kube-api-access-dxx97" (OuterVolumeSpecName: "kube-api-access-dxx97") pod "8758f859-48b6-4ab8-83b1-318b99eecaa0" (UID: "8758f859-48b6-4ab8-83b1-318b99eecaa0"). InnerVolumeSpecName "kube-api-access-dxx97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:33:50.637979 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.637972    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8758f859-48b6-4ab8-83b1-318b99eecaa0" (UID: "8758f859-48b6-4ab8-83b1-318b99eecaa0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.638122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.637989    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-online-tls" (OuterVolumeSpecName: "online-tls") pod "8758f859-48b6-4ab8-83b1-318b99eecaa0" (UID: "8758f859-48b6-4ab8-83b1-318b99eecaa0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.638122 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.638006    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8758f859-48b6-4ab8-83b1-318b99eecaa0" (UID: "8758f859-48b6-4ab8-83b1-318b99eecaa0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.646713 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.646694    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:33:50.652104 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652082    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerID="da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87" exitCode=137
Sep 07 17:33:50.652104 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652099    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerID="fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355" exitCode=137
Sep 07 17:33:50.652280 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652151    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"
Sep 07 17:33:50.652280 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652154    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"}
Sep 07 17:33:50.652280 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652200    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"}
Sep 07 17:33:50.652280 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652222    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx" event={"ID":"ce370b8c-4f3e-48c9-889b-258611ec8722","Type":"ContainerDied","Data":"dcf88c1ad1f5213a7790f77597eff417f88be3cd08c2bd0bb649a2fc49c9c5dd"}
Sep 07 17:33:50.652280 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.652241    2566 scope.go:117] "RemoveContainer" containerID="5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"
Sep 07 17:33:50.654676 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.654655    2566 generic.go:356] "Generic (PLEG): container finished" podID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerID="183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525" exitCode=137
Sep 07 17:33:50.654792 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.654700    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerDied","Data":"183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525"}
Sep 07 17:33:50.654792 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.654707    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"
Sep 07 17:33:50.654792 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.654724    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq" event={"ID":"8758f859-48b6-4ab8-83b1-318b99eecaa0","Type":"ContainerDied","Data":"d1fce358006a516cc0f767f830cf60c654d2360123745ce804074963d47412a1"}
Sep 07 17:33:50.660917 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.660899    2566 scope.go:117] "RemoveContainer" containerID="da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"
Sep 07 17:33:50.668269 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.668254    2566 scope.go:117] "RemoveContainer" containerID="b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"
Sep 07 17:33:50.676358 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.676338    2566 scope.go:117] "RemoveContainer" containerID="fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"
Sep 07 17:33:50.683985 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.683969    2566 scope.go:117] "RemoveContainer" containerID="81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"
Sep 07 17:33:50.688482 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.688462    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"]
Sep 07 17:33:50.692106 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.692087    2566 scope.go:117] "RemoveContainer" containerID="ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"
Sep 07 17:33:50.692386 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.692368    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-89wrq"]
Sep 07 17:33:50.698928 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.698910    2566 scope.go:117] "RemoveContainer" containerID="5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"
Sep 07 17:33:50.699183 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.699164    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f\": container with ID starting with 5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f not found: ID does not exist" containerID="5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"
Sep 07 17:33:50.699250 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.699195    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"} err="failed to get container status \"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f\": rpc error: code = NotFound desc = could not find container \"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f\": container with ID starting with 5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f not found: ID does not exist"
Sep 07 17:33:50.699250 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.699221    2566 scope.go:117] "RemoveContainer" containerID="da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"
Sep 07 17:33:50.699486 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.699470    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87\": container with ID starting with da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87 not found: ID does not exist" containerID="da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"
Sep 07 17:33:50.699527 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.699491    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"} err="failed to get container status \"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87\": rpc error: code = NotFound desc = could not find container \"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87\": container with ID starting with da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87 not found: ID does not exist"
Sep 07 17:33:50.699527 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.699508    2566 scope.go:117] "RemoveContainer" containerID="b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"
Sep 07 17:33:50.699775 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.699757    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f\": container with ID starting with b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f not found: ID does not exist" containerID="b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"
Sep 07 17:33:50.699827 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.699780    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"} err="failed to get container status \"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f\": rpc error: code = NotFound desc = could not find container \"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f\": container with ID starting with b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f not found: ID does not exist"
Sep 07 17:33:50.699827 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.699794    2566 scope.go:117] "RemoveContainer" containerID="fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"
Sep 07 17:33:50.700071 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.700054    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355\": container with ID starting with fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355 not found: ID does not exist" containerID="fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"
Sep 07 17:33:50.700124 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700075    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"} err="failed to get container status \"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355\": rpc error: code = NotFound desc = could not find container \"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355\": container with ID starting with fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355 not found: ID does not exist"
Sep 07 17:33:50.700124 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700088    2566 scope.go:117] "RemoveContainer" containerID="81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"
Sep 07 17:33:50.700321 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.700307    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9\": container with ID starting with 81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9 not found: ID does not exist" containerID="81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"
Sep 07 17:33:50.700361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700324    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"} err="failed to get container status \"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9\": rpc error: code = NotFound desc = could not find container \"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9\": container with ID starting with 81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9 not found: ID does not exist"
Sep 07 17:33:50.700361 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700335    2566 scope.go:117] "RemoveContainer" containerID="ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"
Sep 07 17:33:50.700558 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.700541    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333\": container with ID starting with ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333 not found: ID does not exist" containerID="ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"
Sep 07 17:33:50.700605 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700565    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"} err="failed to get container status \"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333\": rpc error: code = NotFound desc = could not find container \"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333\": container with ID starting with ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333 not found: ID does not exist"
Sep 07 17:33:50.700605 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700576    2566 scope.go:117] "RemoveContainer" containerID="5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"
Sep 07 17:33:50.700829 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700810    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f"} err="failed to get container status \"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f\": rpc error: code = NotFound desc = could not find container \"5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f\": container with ID starting with 5db89af18beb5a3e4a3adefc8b55e4fc58f63b1dc4b6de6d983237ae4d85e65f not found: ID does not exist"
Sep 07 17:33:50.700878 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.700829    2566 scope.go:117] "RemoveContainer" containerID="da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"
Sep 07 17:33:50.701056 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701039    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87"} err="failed to get container status \"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87\": rpc error: code = NotFound desc = could not find container \"da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87\": container with ID starting with da5029071401593456853852ea3396adbef1b8a0d1e9c362dd4f98a131a6bd87 not found: ID does not exist"
Sep 07 17:33:50.701106 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701056    2566 scope.go:117] "RemoveContainer" containerID="b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"
Sep 07 17:33:50.701270 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701253    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f"} err="failed to get container status \"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f\": rpc error: code = NotFound desc = could not find container \"b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f\": container with ID starting with b844f765bb75b5629a6e1e748c52a9bbf9895cf4fd979a1e05243875a4533a9f not found: ID does not exist"
Sep 07 17:33:50.701317 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701271    2566 scope.go:117] "RemoveContainer" containerID="fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"
Sep 07 17:33:50.701474 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701458    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355"} err="failed to get container status \"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355\": rpc error: code = NotFound desc = could not find container \"fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355\": container with ID starting with fb2cf6ae084ecfdd82d706fab7b0d8a86d78b92141a5523a40a76891550a7355 not found: ID does not exist"
Sep 07 17:33:50.701474 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701473    2566 scope.go:117] "RemoveContainer" containerID="81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"
Sep 07 17:33:50.701718 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701700    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9"} err="failed to get container status \"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9\": rpc error: code = NotFound desc = could not find container \"81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9\": container with ID starting with 81dba4229ddbbf13bba727928fcd09e416f38a100bb20862783d877eec7f44f9 not found: ID does not exist"
Sep 07 17:33:50.701780 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701718    2566 scope.go:117] "RemoveContainer" containerID="ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"
Sep 07 17:33:50.701941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701922    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333"} err="failed to get container status \"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333\": rpc error: code = NotFound desc = could not find container \"ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333\": container with ID starting with ebd5df1b5c2f909f0196a7c8a367a599041554ca4f2ac0b0a732bfb80629d333 not found: ID does not exist"
Sep 07 17:33:50.701941 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.701941    2566 scope.go:117] "RemoveContainer" containerID="37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183"
Sep 07 17:33:50.708664 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.708648    2566 scope.go:117] "RemoveContainer" containerID="183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525"
Sep 07 17:33:50.715500 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.715486    2566 scope.go:117] "RemoveContainer" containerID="a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871"
Sep 07 17:33:50.722400 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.722384    2566 scope.go:117] "RemoveContainer" containerID="b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958"
Sep 07 17:33:50.730497 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.730479    2566 scope.go:117] "RemoveContainer" containerID="387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10"
Sep 07 17:33:50.736619 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736595    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce370b8c-4f3e-48c9-889b-258611ec8722-feast-data\") pod \"ce370b8c-4f3e-48c9-889b-258611ec8722\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") "
Sep 07 17:33:50.736716 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736628    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-online-tls\") pod \"ce370b8c-4f3e-48c9-889b-258611ec8722\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") "
Sep 07 17:33:50.736716 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736662    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-registry-tls\") pod \"ce370b8c-4f3e-48c9-889b-258611ec8722\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") "
Sep 07 17:33:50.736857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736721    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w44z\" (UniqueName: \"kubernetes.io/projected/ce370b8c-4f3e-48c9-889b-258611ec8722-kube-api-access-4w44z\") pod \"ce370b8c-4f3e-48c9-889b-258611ec8722\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") "
Sep 07 17:33:50.736857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736752    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-offline-tls\") pod \"ce370b8c-4f3e-48c9-889b-258611ec8722\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") "
Sep 07 17:33:50.736857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736776    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-ui-tls\") pod \"ce370b8c-4f3e-48c9-889b-258611ec8722\" (UID: \"ce370b8c-4f3e-48c9-889b-258611ec8722\") "
Sep 07 17:33:50.737000 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.736969    2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-offline-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.737057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737012    2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-online-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.737057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737024    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8758f859-48b6-4ab8-83b1-318b99eecaa0-registry-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.737057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737035    2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8758f859-48b6-4ab8-83b1-318b99eecaa0-ui-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.737057 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737049    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxx97\" (UniqueName: \"kubernetes.io/projected/8758f859-48b6-4ab8-83b1-318b99eecaa0-kube-api-access-dxx97\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.737259 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737067    2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8758f859-48b6-4ab8-83b1-318b99eecaa0-feast-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.737335 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737305    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce370b8c-4f3e-48c9-889b-258611ec8722-feast-data" (OuterVolumeSpecName: "feast-data") pod "ce370b8c-4f3e-48c9-889b-258611ec8722" (UID: "ce370b8c-4f3e-48c9-889b-258611ec8722"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:33:50.737599 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737580    2566 scope.go:117] "RemoveContainer" containerID="37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183"
Sep 07 17:33:50.737929 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.737900    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183\": container with ID starting with 37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183 not found: ID does not exist" containerID="37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183"
Sep 07 17:33:50.738045 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737938    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183"} err="failed to get container status \"37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183\": rpc error: code = NotFound desc = could not find container \"37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183\": container with ID starting with 37557913c97716abdd22b048a40161834b6b2efc7930eeb735f4c9c078bb8183 not found: ID does not exist"
Sep 07 17:33:50.738045 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.737965    2566 scope.go:117] "RemoveContainer" containerID="183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525"
Sep 07 17:33:50.738463 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.738429    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525\": container with ID starting with 183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525 not found: ID does not exist" containerID="183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525"
Sep 07 17:33:50.738562 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.738470    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525"} err="failed to get container status \"183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525\": rpc error: code = NotFound desc = could not find container \"183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525\": container with ID starting with 183d002412a99a0bd11506350f56b7aa4e60914702425a08e65a779e727d4525 not found: ID does not exist"
Sep 07 17:33:50.738562 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.738492    2566 scope.go:117] "RemoveContainer" containerID="a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871"
Sep 07 17:33:50.738912 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.738886    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871\": container with ID starting with a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871 not found: ID does not exist" containerID="a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871"
Sep 07 17:33:50.738993 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.738920    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871"} err="failed to get container status \"a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871\": rpc error: code = NotFound desc = could not find container \"a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871\": container with ID starting with a7679a4c07e2ab97b331053e15b0309a692f52d5e4a2a6faab3707de035c4871 not found: ID does not exist"
Sep 07 17:33:50.738993 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.738937    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ce370b8c-4f3e-48c9-889b-258611ec8722" (UID: "ce370b8c-4f3e-48c9-889b-258611ec8722"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.738993 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.738945    2566 scope.go:117] "RemoveContainer" containerID="b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958"
Sep 07 17:33:50.739246 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.739225    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958\": container with ID starting with b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958 not found: ID does not exist" containerID="b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958"
Sep 07 17:33:50.739307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739251    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958"} err="failed to get container status \"b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958\": rpc error: code = NotFound desc = could not find container \"b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958\": container with ID starting with b64732135dd883fc59c3f781da2fade4160c96994d2c03bff9275d3afa343958 not found: ID does not exist"
Sep 07 17:33:50.739307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739276    2566 scope.go:117] "RemoveContainer" containerID="387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10"
Sep 07 17:33:50.739401 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739326    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-online-tls" (OuterVolumeSpecName: "online-tls") pod "ce370b8c-4f3e-48c9-889b-258611ec8722" (UID: "ce370b8c-4f3e-48c9-889b-258611ec8722"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.739452 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739403    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce370b8c-4f3e-48c9-889b-258611ec8722-kube-api-access-4w44z" (OuterVolumeSpecName: "kube-api-access-4w44z") pod "ce370b8c-4f3e-48c9-889b-258611ec8722" (UID: "ce370b8c-4f3e-48c9-889b-258611ec8722"). InnerVolumeSpecName "kube-api-access-4w44z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:33:50.739496 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739455    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ce370b8c-4f3e-48c9-889b-258611ec8722" (UID: "ce370b8c-4f3e-48c9-889b-258611ec8722"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.739496 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739477    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce370b8c-4f3e-48c9-889b-258611ec8722" (UID: "ce370b8c-4f3e-48c9-889b-258611ec8722"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:33:50.739569 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:33:50.739548    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10\": container with ID starting with 387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10 not found: ID does not exist" containerID="387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10"
Sep 07 17:33:50.739613 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.739570    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10"} err="failed to get container status \"387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10\": rpc error: code = NotFound desc = could not find container \"387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10\": container with ID starting with 387a754abe863e3f48af3c073cccdfa9de32ffba567ea7fe46096a6f2e6ace10 not found: ID does not exist"
Sep 07 17:33:50.770851 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.770826    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" path="/var/lib/kubelet/pods/8758f859-48b6-4ab8-83b1-318b99eecaa0/volumes"
Sep 07 17:33:50.837990 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.837957    2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-ui-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.837990 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.837988    2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ce370b8c-4f3e-48c9-889b-258611ec8722-feast-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.837990 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.837998    2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-online-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.838217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.838011    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-registry-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.838217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.838104    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w44z\" (UniqueName: \"kubernetes.io/projected/ce370b8c-4f3e-48c9-889b-258611ec8722-kube-api-access-4w44z\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.838217 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.838140    2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ce370b8c-4f3e-48c9-889b-258611ec8722-offline-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:33:50.969063 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.968992    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"]
Sep 07 17:33:50.973371 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:50.973346    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lr6mx"]
Sep 07 17:33:52.771496 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:33:52.771460    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" path="/var/lib/kubelet/pods/ce370b8c-4f3e-48c9-889b-258611ec8722/volumes"
Sep 07 17:34:32.642097 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642058    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"]
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642331    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642342    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642349    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642355    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642363    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="offline"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642369    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="offline"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642377    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642383    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642393    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642398    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642403    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="feast-apply"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642408    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="feast-apply"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642415    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="feast-init"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642420    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="feast-init"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642427    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="registry"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642433    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="registry"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642442    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="feast-apply"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642447    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="feast-apply"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642453    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="offline"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642458    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="offline"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642465    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="feast-init"
Sep 07 17:34:32.642493 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642471    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="feast-init"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642516    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="ui"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642524    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="offline"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642530    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="offline"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642534    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="registry"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642539    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="ui"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642545    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce370b8c-4f3e-48c9-889b-258611ec8722" containerName="online"
Sep 07 17:34:32.643154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.642550    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8758f859-48b6-4ab8-83b1-318b99eecaa0" containerName="online"
Sep 07 17:34:32.645804 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.645786    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.652353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.651998    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 07 17:34:32.652353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.652257    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 07 17:34:32.652353 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.652268    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 07 17:34:32.653213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.653180    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 07 17:34:32.653213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.653180    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 07 17:34:32.653385 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.653232    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jgqrq\""
Sep 07 17:34:32.653385 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.653232    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 07 17:34:32.752458 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.752425    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"]
Sep 07 17:34:32.766257 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.766231    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.766370 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.766269    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9652d5-0576-460e-b9d1-dc0822d813e9-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.766370 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.766289    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.766370 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.766331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.766465 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.766394    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.766465 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.766422    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzcb\" (UniqueName: \"kubernetes.io/projected/fa9652d5-0576-460e-b9d1-dc0822d813e9-kube-api-access-9tzcb\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.867546 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.867507    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.867546 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.867547    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzcb\" (UniqueName: \"kubernetes.io/projected/fa9652d5-0576-460e-b9d1-dc0822d813e9-kube-api-access-9tzcb\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.867797 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.867589    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.867797 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.867615    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9652d5-0576-460e-b9d1-dc0822d813e9-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.867797 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.867633    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.867797 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.867656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.868087 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.868062    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9652d5-0576-460e-b9d1-dc0822d813e9-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.870124 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.870083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.870224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.870133    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.870224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.870194    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.870296 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.870244    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.880652 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.880629    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzcb\" (UniqueName: \"kubernetes.io/projected/fa9652d5-0576-460e-b9d1-dc0822d813e9-kube-api-access-9tzcb\") pod \"feast-simple-feast-setup-57576b8fcf-g9vsh\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:32.963874 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:32.963795    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:33.250319 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:33.250292    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"]
Sep 07 17:34:33.252127 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:34:33.252106    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa9652d5_0576_460e_b9d1_dc0822d813e9.slice/crio-e1a542f7ad54accee9fe6b99995d620a4bc774c2594b2fe91fc229ed83b97480 WatchSource:0}: Error finding container e1a542f7ad54accee9fe6b99995d620a4bc774c2594b2fe91fc229ed83b97480: Status 404 returned error can't find the container with id e1a542f7ad54accee9fe6b99995d620a4bc774c2594b2fe91fc229ed83b97480
Sep 07 17:34:33.814804 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:33.814769    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"}
Sep 07 17:34:33.815188 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:33.814819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"e1a542f7ad54accee9fe6b99995d620a4bc774c2594b2fe91fc229ed83b97480"}
Sep 07 17:34:38.833141 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:38.833105    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerID="d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4" exitCode=0
Sep 07 17:34:38.833563 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:38.833177    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"}
Sep 07 17:34:39.838986 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:39.838946    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"}
Sep 07 17:34:44.858841 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:44.858807    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerID="a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d" exitCode=0
Sep 07 17:34:44.858841 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:44.858846    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"}
Sep 07 17:34:45.868154 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:45.868107    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"}
Sep 07 17:34:45.868641 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:45.868166    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"}
Sep 07 17:34:45.868641 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:45.868192    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"}
Sep 07 17:34:45.868641 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:45.868210    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerStarted","Data":"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"}
Sep 07 17:34:45.901565 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:45.901479    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podStartSLOduration=13.901437257 podStartE2EDuration="13.901437257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:34:45.900787894 +0000 UTC m=+1571.637596338" watchObservedRunningTime="2026-09-07 17:34:45.901437257 +0000 UTC m=+1571.638245669"
Sep 07 17:34:47.964723 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.964677    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:47.965215 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.964758    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:47.965215 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.964779    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:47.965215 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.964796    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:47.966809 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.966771    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
Sep 07 17:34:47.966809 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.966794    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Sep 07 17:34:47.966974 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.966838    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
Sep 07 17:34:47.967100 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:47.967063    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Sep 07 17:34:50.964375 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:50.964320    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
Sep 07 17:34:50.964884 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:50.964341    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
Sep 07 17:34:50.964884 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:50.964454    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Sep 07 17:34:50.964884 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:50.964339    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Sep 07 17:34:52.964796 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:52.964722    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:52.965245 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:52.964821    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:52.965245 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:52.964843    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:52.965245 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:52.964862    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.965001 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.964963    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.965464 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.965165    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.965464 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.965295    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.965885 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.965857    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.966005 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.965985    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.966091 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.966076    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:53.970565 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:53.970544    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:34:54.918580 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:34:54.918543    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:35:56.378585 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.378552    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"]
Sep 07 17:35:56.379148 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.378802    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="registry" containerID="cri-o://bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad" gracePeriod=30
Sep 07 17:35:56.379148 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.378849    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui" containerID="cri-o://47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8" gracePeriod=30
Sep 07 17:35:56.379148 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.378862    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="offline" containerID="cri-o://7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95" gracePeriod=30
Sep 07 17:35:56.379148 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.378862    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online" containerID="cri-o://36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e" gracePeriod=30
Sep 07 17:35:56.923229 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.923192    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"]
Sep 07 17:35:56.927049 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.927031    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:56.929801 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.929777    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-m5jjb\""
Sep 07 17:35:56.943900 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:56.943867    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"]
Sep 07 17:35:57.057586 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.057545    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.057775 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.057618    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.057775 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.057641    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkq47\" (UniqueName: \"kubernetes.io/projected/c55e8353-c7fc-4e99-8432-a04f00bab8d8-kube-api-access-nkq47\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.057775 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.057708    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c55e8353-c7fc-4e99-8432-a04f00bab8d8-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.057892 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.057782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.057892 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.057813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.147625 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.147598    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerID="47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8" exitCode=0
Sep 07 17:35:57.147756 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.147663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"}
Sep 07 17:35:57.158977 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.158953    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.159055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.158984    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkq47\" (UniqueName: \"kubernetes.io/projected/c55e8353-c7fc-4e99-8432-a04f00bab8d8-kube-api-access-nkq47\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.159055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.159006    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c55e8353-c7fc-4e99-8432-a04f00bab8d8-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.159055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.159037    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.159186 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.159074    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.159186 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.159104    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.159446 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.159415    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c55e8353-c7fc-4e99-8432-a04f00bab8d8-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.161496 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.161469    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.161647 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.161628    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.161689 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.161644    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.161689 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.161651    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.167967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.167948    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkq47\" (UniqueName: \"kubernetes.io/projected/c55e8353-c7fc-4e99-8432-a04f00bab8d8-kube-api-access-nkq47\") pod \"feast-simple-feast-setup-57576b8fcf-t7th2\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.236610 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.236579    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:35:57.513115 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:57.512869    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"]
Sep 07 17:35:57.515425 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:35:57.515397    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc55e8353_c7fc_4e99_8432_a04f00bab8d8.slice/crio-50864f2c0b568c62fb99afa4f0ed0cda7a1af8e8ff66f3958618ea54c314d437 WatchSource:0}: Error finding container 50864f2c0b568c62fb99afa4f0ed0cda7a1af8e8ff66f3958618ea54c314d437: Status 404 returned error can't find the container with id 50864f2c0b568c62fb99afa4f0ed0cda7a1af8e8ff66f3958618ea54c314d437
Sep 07 17:35:58.155269 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:58.155231    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerID="36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e" exitCode=0
Sep 07 17:35:58.155439 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:58.155296    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"}
Sep 07 17:35:58.156841 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:58.156816    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"dad6fe27f6c50530f6c70fa16314d36c798f43387133b38a957dc61f81385a27"}
Sep 07 17:35:58.156963 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:35:58.156852    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"50864f2c0b568c62fb99afa4f0ed0cda7a1af8e8ff66f3958618ea54c314d437"}
Sep 07 17:36:03.177911 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:03.177876    2566 generic.go:356] "Generic (PLEG): container finished" podID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerID="dad6fe27f6c50530f6c70fa16314d36c798f43387133b38a957dc61f81385a27" exitCode=0
Sep 07 17:36:03.178317 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:03.177953    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"dad6fe27f6c50530f6c70fa16314d36c798f43387133b38a957dc61f81385a27"}
Sep 07 17:36:03.966344 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:03.966298    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Sep 07 17:36:04.184404 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:04.184368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"1c038b38e7e3eb0a81e460384c85a5bc067311dc3b60283c572a80e7b8984c21"}
Sep 07 17:36:04.915662 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:04.915620    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Sep 07 17:36:09.206521 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:09.206489    2566 generic.go:356] "Generic (PLEG): container finished" podID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerID="1c038b38e7e3eb0a81e460384c85a5bc067311dc3b60283c572a80e7b8984c21" exitCode=0
Sep 07 17:36:09.206918 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:09.206570    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"1c038b38e7e3eb0a81e460384c85a5bc067311dc3b60283c572a80e7b8984c21"}
Sep 07 17:36:10.217157 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:10.217108    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"2e053e9f7960b1579d9c79fc693d4e792be8eaeb02bedd07dfa5c426d6a998cb"}
Sep 07 17:36:10.217632 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:10.217185    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"7a774b22c0be22f46df67aff1708f29399e22d4e1a65df6b0a9a2e79f98718e2"}
Sep 07 17:36:10.217632 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:10.217211    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"258fe0f48660e6c86240bf2c06265417c16c477509be4c2f2ebea74e1c7b8c57"}
Sep 07 17:36:10.217632 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:10.217230    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerStarted","Data":"f94060c3034f5d4422b3730cccdd5e1a1afa932a50941a77838060fa80feb68b"}
Sep 07 17:36:10.246982 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:10.246913    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podStartSLOduration=14.246892406 podStartE2EDuration="14.246892406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:36:10.24485542 +0000 UTC m=+1655.981663835" watchObservedRunningTime="2026-09-07 17:36:10.246892406 +0000 UTC m=+1655.983700818"
Sep 07 17:36:12.237532 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.237081    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:12.237532 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.237148    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:12.237532 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.237167    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:12.237532 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.237186    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:12.239410 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.239367    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused"
Sep 07 17:36:12.239546 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.239399    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Sep 07 17:36:12.239546 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.239441    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Sep 07 17:36:12.239705 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:12.239669    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
Sep 07 17:36:13.966043 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:13.965990    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Sep 07 17:36:14.916194 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:14.916137    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Sep 07 17:36:15.237273 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:15.237158    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Sep 07 17:36:15.237273 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:15.237158    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.23:6571: connect: connection refused"
Sep 07 17:36:15.237273 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:15.237265    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Sep 07 17:36:15.237876 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:15.237503    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
Sep 07 17:36:17.237245 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:17.237201    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:17.237625 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:17.237274    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:17.237625 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:17.237289    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:17.237625 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:17.237301    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.238017 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.237986    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.238465 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.238118    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.238465 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.238375    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.239150 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.239123    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.239261 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.239194    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.239300 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.239257    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.243140 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.243120    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:18.266065 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:18.266040    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:36:23.966588 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:23.966536    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Sep 07 17:36:23.967104 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:23.966704    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:36:24.915606 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:24.915562    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Sep 07 17:36:24.915819 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:24.915700    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:36:27.028459 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.028437    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:36:27.100966 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.100934    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tzcb\" (UniqueName: \"kubernetes.io/projected/fa9652d5-0576-460e-b9d1-dc0822d813e9-kube-api-access-9tzcb\") pod \"fa9652d5-0576-460e-b9d1-dc0822d813e9\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") "
Sep 07 17:36:27.101131 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.100972    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-offline-tls\") pod \"fa9652d5-0576-460e-b9d1-dc0822d813e9\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") "
Sep 07 17:36:27.101131 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.101003    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9652d5-0576-460e-b9d1-dc0822d813e9-feast-data\") pod \"fa9652d5-0576-460e-b9d1-dc0822d813e9\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") "
Sep 07 17:36:27.101131 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.101019    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-ui-tls\") pod \"fa9652d5-0576-460e-b9d1-dc0822d813e9\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") "
Sep 07 17:36:27.101131 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.101038    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-online-tls\") pod \"fa9652d5-0576-460e-b9d1-dc0822d813e9\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") "
Sep 07 17:36:27.101131 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.101072    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-registry-tls\") pod \"fa9652d5-0576-460e-b9d1-dc0822d813e9\" (UID: \"fa9652d5-0576-460e-b9d1-dc0822d813e9\") "
Sep 07 17:36:27.101541 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.101510    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa9652d5-0576-460e-b9d1-dc0822d813e9-feast-data" (OuterVolumeSpecName: "feast-data") pod "fa9652d5-0576-460e-b9d1-dc0822d813e9" (UID: "fa9652d5-0576-460e-b9d1-dc0822d813e9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:36:27.103405 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.103376    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "fa9652d5-0576-460e-b9d1-dc0822d813e9" (UID: "fa9652d5-0576-460e-b9d1-dc0822d813e9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:36:27.103554 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.103530    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-online-tls" (OuterVolumeSpecName: "online-tls") pod "fa9652d5-0576-460e-b9d1-dc0822d813e9" (UID: "fa9652d5-0576-460e-b9d1-dc0822d813e9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:36:27.103664 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.103640    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa9652d5-0576-460e-b9d1-dc0822d813e9-kube-api-access-9tzcb" (OuterVolumeSpecName: "kube-api-access-9tzcb") pod "fa9652d5-0576-460e-b9d1-dc0822d813e9" (UID: "fa9652d5-0576-460e-b9d1-dc0822d813e9"). InnerVolumeSpecName "kube-api-access-9tzcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:36:27.103775 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.103686    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa9652d5-0576-460e-b9d1-dc0822d813e9" (UID: "fa9652d5-0576-460e-b9d1-dc0822d813e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:36:27.103775 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.103696    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "fa9652d5-0576-460e-b9d1-dc0822d813e9" (UID: "fa9652d5-0576-460e-b9d1-dc0822d813e9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:36:27.202092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.202008    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tzcb\" (UniqueName: \"kubernetes.io/projected/fa9652d5-0576-460e-b9d1-dc0822d813e9-kube-api-access-9tzcb\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:36:27.202092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.202036    2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-offline-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:36:27.202092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.202046    2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa9652d5-0576-460e-b9d1-dc0822d813e9-feast-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:36:27.202092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.202054    2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-ui-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:36:27.202092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.202061    2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-online-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:36:27.202092 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.202068    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa9652d5-0576-460e-b9d1-dc0822d813e9-registry-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:36:27.298785 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298753    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerID="7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95" exitCode=137
Sep 07 17:36:27.298785 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298777    2566 generic.go:356] "Generic (PLEG): container finished" podID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerID="bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad" exitCode=137
Sep 07 17:36:27.298949 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298804    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"}
Sep 07 17:36:27.298949 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298824    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"
Sep 07 17:36:27.298949 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298837    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"}
Sep 07 17:36:27.298949 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298852    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh" event={"ID":"fa9652d5-0576-460e-b9d1-dc0822d813e9","Type":"ContainerDied","Data":"e1a542f7ad54accee9fe6b99995d620a4bc774c2594b2fe91fc229ed83b97480"}
Sep 07 17:36:27.298949 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.298869    2566 scope.go:117] "RemoveContainer" containerID="47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"
Sep 07 17:36:27.307713 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.307688    2566 scope.go:117] "RemoveContainer" containerID="7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"
Sep 07 17:36:27.315004 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.314986    2566 scope.go:117] "RemoveContainer" containerID="36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"
Sep 07 17:36:27.322118 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.322075    2566 scope.go:117] "RemoveContainer" containerID="bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"
Sep 07 17:36:27.322991 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.322939    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"]
Sep 07 17:36:27.327639 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.327615    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-g9vsh"]
Sep 07 17:36:27.330155 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.330139    2566 scope.go:117] "RemoveContainer" containerID="a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"
Sep 07 17:36:27.337224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.337204    2566 scope.go:117] "RemoveContainer" containerID="d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"
Sep 07 17:36:27.344107 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344089    2566 scope.go:117] "RemoveContainer" containerID="47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"
Sep 07 17:36:27.344368 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:36:27.344350    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8\": container with ID starting with 47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8 not found: ID does not exist" containerID="47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"
Sep 07 17:36:27.344408 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344381    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"} err="failed to get container status \"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8\": rpc error: code = NotFound desc = could not find container \"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8\": container with ID starting with 47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8 not found: ID does not exist"
Sep 07 17:36:27.344408 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344398    2566 scope.go:117] "RemoveContainer" containerID="7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"
Sep 07 17:36:27.344661 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:36:27.344640    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95\": container with ID starting with 7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95 not found: ID does not exist" containerID="7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"
Sep 07 17:36:27.344711 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344666    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"} err="failed to get container status \"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95\": rpc error: code = NotFound desc = could not find container \"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95\": container with ID starting with 7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95 not found: ID does not exist"
Sep 07 17:36:27.344711 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344683    2566 scope.go:117] "RemoveContainer" containerID="36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"
Sep 07 17:36:27.344907 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:36:27.344890    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e\": container with ID starting with 36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e not found: ID does not exist" containerID="36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"
Sep 07 17:36:27.344967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344910    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"} err="failed to get container status \"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e\": rpc error: code = NotFound desc = could not find container \"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e\": container with ID starting with 36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e not found: ID does not exist"
Sep 07 17:36:27.344967 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.344927    2566 scope.go:117] "RemoveContainer" containerID="bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"
Sep 07 17:36:27.345215 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:36:27.345195    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad\": container with ID starting with bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad not found: ID does not exist" containerID="bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"
Sep 07 17:36:27.345292 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345220    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"} err="failed to get container status \"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad\": rpc error: code = NotFound desc = could not find container \"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad\": container with ID starting with bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad not found: ID does not exist"
Sep 07 17:36:27.345292 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345234    2566 scope.go:117] "RemoveContainer" containerID="a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"
Sep 07 17:36:27.345476 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:36:27.345459    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d\": container with ID starting with a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d not found: ID does not exist" containerID="a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"
Sep 07 17:36:27.345513 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345483    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"} err="failed to get container status \"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d\": rpc error: code = NotFound desc = could not find container \"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d\": container with ID starting with a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d not found: ID does not exist"
Sep 07 17:36:27.345513 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345499    2566 scope.go:117] "RemoveContainer" containerID="d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"
Sep 07 17:36:27.345716 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:36:27.345700    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4\": container with ID starting with d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4 not found: ID does not exist" containerID="d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"
Sep 07 17:36:27.345766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345719    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"} err="failed to get container status \"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4\": rpc error: code = NotFound desc = could not find container \"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4\": container with ID starting with d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4 not found: ID does not exist"
Sep 07 17:36:27.345766 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345746    2566 scope.go:117] "RemoveContainer" containerID="47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"
Sep 07 17:36:27.345996 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.345978    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8"} err="failed to get container status \"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8\": rpc error: code = NotFound desc = could not find container \"47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8\": container with ID starting with 47c08803ee880e12133b17b7af71b14e945260fb5068b80e001af28c06ceaca8 not found: ID does not exist"
Sep 07 17:36:27.346039 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346005    2566 scope.go:117] "RemoveContainer" containerID="7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"
Sep 07 17:36:27.346222 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346206    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95"} err="failed to get container status \"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95\": rpc error: code = NotFound desc = could not find container \"7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95\": container with ID starting with 7c622c0dc93b901ddddc8b3d4910ecbde7abbda7fbb1754232329c9d4b17aa95 not found: ID does not exist"
Sep 07 17:36:27.346222 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346221    2566 scope.go:117] "RemoveContainer" containerID="36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"
Sep 07 17:36:27.346435 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346418    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e"} err="failed to get container status \"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e\": rpc error: code = NotFound desc = could not find container \"36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e\": container with ID starting with 36e7d7c68e64b088044d297ca163416a09ed5210b12acb3c6b685e51ee76bf3e not found: ID does not exist"
Sep 07 17:36:27.346435 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346434    2566 scope.go:117] "RemoveContainer" containerID="bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"
Sep 07 17:36:27.346683 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346665    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad"} err="failed to get container status \"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad\": rpc error: code = NotFound desc = could not find container \"bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad\": container with ID starting with bec6af7def8106660a463491c9c371848ffff569ed7f239c990a419e41b677ad not found: ID does not exist"
Sep 07 17:36:27.346727 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346684    2566 scope.go:117] "RemoveContainer" containerID="a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"
Sep 07 17:36:27.346932 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346912    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d"} err="failed to get container status \"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d\": rpc error: code = NotFound desc = could not find container \"a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d\": container with ID starting with a8774e4e6fbf03f09d9b9c7f923f6ac1a8a4ba1d9f17d9e4f9d944c655c4852d not found: ID does not exist"
Sep 07 17:36:27.346979 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.346933    2566 scope.go:117] "RemoveContainer" containerID="d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"
Sep 07 17:36:27.347172 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:27.347150    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4"} err="failed to get container status \"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4\": rpc error: code = NotFound desc = could not find container \"d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4\": container with ID starting with d4719f007a702b9d5295dd99d2b592271222ed7dd8d2fe12082533ea60055bd4 not found: ID does not exist"
Sep 07 17:36:28.771822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:36:28.771787    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" path="/var/lib/kubelet/pods/fa9652d5-0576-460e-b9d1-dc0822d813e9/volumes"
Sep 07 17:37:21.431202 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431168    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"]
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431439    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="feast-init"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431450    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="feast-init"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431462    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="offline"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431467    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="offline"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431475    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="registry"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431481    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="registry"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431490    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="feast-apply"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431495    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="feast-apply"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431503    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431508    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431514    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431519    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431571    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="online"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431578    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="offline"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431585    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="registry"
Sep 07 17:37:21.431651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.431592    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa9652d5-0576-460e-b9d1-dc0822d813e9" containerName="ui"
Sep 07 17:37:21.435111 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.435096    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.437703 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.437673    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 07 17:37:21.437857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.437792    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 07 17:37:21.437857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.437818    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-9zw7z\""
Sep 07 17:37:21.437857 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.437825    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 07 17:37:21.438034 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.437864    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 07 17:37:21.438119 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.438097    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 07 17:37:21.438940 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.438922    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 07 17:37:21.445348 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.445329    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"]
Sep 07 17:37:21.532654 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.532621    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.532654 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.532659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b87745b-0a43-4629-b336-ad3d1bbc615d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.532883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.532697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.532883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.532781    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b87745b-0a43-4629-b336-ad3d1bbc615d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.532883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.532824    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.532992 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.532887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9tkr\" (UniqueName: \"kubernetes.io/projected/7b87745b-0a43-4629-b336-ad3d1bbc615d-kube-api-access-r9tkr\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634081 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634045    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9tkr\" (UniqueName: \"kubernetes.io/projected/7b87745b-0a43-4629-b336-ad3d1bbc615d-kube-api-access-r9tkr\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634150    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b87745b-0a43-4629-b336-ad3d1bbc615d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634176    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b87745b-0a43-4629-b336-ad3d1bbc615d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634248 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634507 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:37:21.634264    2566 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 07 17:37:21.634507 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:37:21.634328    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls podName:7b87745b-0a43-4629-b336-ad3d1bbc615d nodeName:}" failed. No retries permitted until 2026-09-07 17:37:22.134312079 +0000 UTC m=+1727.871120470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d") : secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 07 17:37:21.634930 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634606    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b87745b-0a43-4629-b336-ad3d1bbc615d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.634930 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.634882    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b87745b-0a43-4629-b336-ad3d1bbc615d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.636708 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.636690    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.636772 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.636754    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:21.644619 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:21.644592    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9tkr\" (UniqueName: \"kubernetes.io/projected/7b87745b-0a43-4629-b336-ad3d1bbc615d-kube-api-access-r9tkr\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:22.138999 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:22.138959    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:22.141352 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:22.141331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-jzj4v\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:22.344515 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:22.344476    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:22.623076 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:22.623048    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"]
Sep 07 17:37:22.624803 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:37:22.624778    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b87745b_0a43_4629_b336_ad3d1bbc615d.slice/crio-492f099e5c903f0034b913b5c154e5d3615c57e059ad06ecc6d2da6be177b7ee WatchSource:0}: Error finding container 492f099e5c903f0034b913b5c154e5d3615c57e059ad06ecc6d2da6be177b7ee: Status 404 returned error can't find the container with id 492f099e5c903f0034b913b5c154e5d3615c57e059ad06ecc6d2da6be177b7ee
Sep 07 17:37:23.504807 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:23.504774    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerStarted","Data":"f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304"}
Sep 07 17:37:23.504989 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:23.504822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerStarted","Data":"492f099e5c903f0034b913b5c154e5d3615c57e059ad06ecc6d2da6be177b7ee"}
Sep 07 17:37:28.525231 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:28.525197    2566 generic.go:356] "Generic (PLEG): container finished" podID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerID="f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304" exitCode=0
Sep 07 17:37:28.525630 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:28.525250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerDied","Data":"f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304"}
Sep 07 17:37:29.532222 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:29.532182    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerStarted","Data":"78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3"}
Sep 07 17:37:50.626915 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:50.626873    2566 generic.go:356] "Generic (PLEG): container finished" podID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerID="78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3" exitCode=0
Sep 07 17:37:50.627315 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:50.626954    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerDied","Data":"78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3"}
Sep 07 17:37:51.636184 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:51.636144    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerStarted","Data":"f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a"}
Sep 07 17:37:51.636708 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:51.636197    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerStarted","Data":"9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3"}
Sep 07 17:37:51.636708 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:51.636211    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerStarted","Data":"d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c"}
Sep 07 17:37:51.661019 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:51.660956    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podStartSLOduration=30.66093378 podStartE2EDuration="30.66093378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 17:37:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:37:51.660337938 +0000 UTC m=+1757.397146350" watchObservedRunningTime="2026-09-07 17:37:51.66093378 +0000 UTC m=+1757.397742193"
Sep 07 17:37:52.344893 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.344844    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:52.345127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.345007    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:52.345127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.345055    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:52.345127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.345073    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:52.345127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.345090    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:52.345127 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.345104    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:52.347029 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.346995    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
Sep 07 17:37:52.347170 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.347019    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 07 17:37:52.347170 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:52.347071    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 07 17:37:55.344845 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:55.344804    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
Sep 07 17:37:55.345293 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:55.344804    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 07 17:37:55.345293 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:55.344816    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 07 17:37:58.344759 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:58.344696    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 07 17:37:58.345224 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:58.344710    2566 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 07 17:37:58.345849 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:58.345824    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:37:58.346612 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:37:58.346593    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:38:01.346001 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:38:01.345970    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:38:01.346822 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:38:01.346802    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:38:02.057406 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:38:02.057371    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:38:03.348883 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:38:03.348838    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 17:38:04.281378 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:38:04.281346    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:39:05.603273 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.603240    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"]
Sep 07 17:39:05.603901 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.603462    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" containerID="cri-o://d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c" gracePeriod=30
Sep 07 17:39:05.603901 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.603553    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" containerID="cri-o://f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a" gracePeriod=30
Sep 07 17:39:05.603901 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.603534    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="offline" containerID="cri-o://9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3" gracePeriod=30
Sep 07 17:39:05.743254 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.743218    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"]
Sep 07 17:39:05.743554 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.743462    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="registry" containerID="cri-o://f94060c3034f5d4422b3730cccdd5e1a1afa932a50941a77838060fa80feb68b" gracePeriod=30
Sep 07 17:39:05.743554 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.743499    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui" containerID="cri-o://2e053e9f7960b1579d9c79fc693d4e792be8eaeb02bedd07dfa5c426d6a998cb" gracePeriod=30
Sep 07 17:39:05.743554 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.743518    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online" containerID="cri-o://258fe0f48660e6c86240bf2c06265417c16c477509be4c2f2ebea74e1c7b8c57" gracePeriod=30
Sep 07 17:39:05.743770 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:05.743520    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="offline" containerID="cri-o://7a774b22c0be22f46df67aff1708f29399e22d4e1a65df6b0a9a2e79f98718e2" gracePeriod=30
Sep 07 17:39:06.946713 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.946675    2566 generic.go:356] "Generic (PLEG): container finished" podID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerID="f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a" exitCode=0
Sep 07 17:39:06.946713 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.946709    2566 generic.go:356] "Generic (PLEG): container finished" podID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerID="d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c" exitCode=0
Sep 07 17:39:06.947192 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.946756    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerDied","Data":"f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a"}
Sep 07 17:39:06.947192 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.946800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerDied","Data":"d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c"}
Sep 07 17:39:06.949899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.949879    2566 generic.go:356] "Generic (PLEG): container finished" podID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerID="2e053e9f7960b1579d9c79fc693d4e792be8eaeb02bedd07dfa5c426d6a998cb" exitCode=0
Sep 07 17:39:06.949899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.949896    2566 generic.go:356] "Generic (PLEG): container finished" podID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerID="258fe0f48660e6c86240bf2c06265417c16c477509be4c2f2ebea74e1c7b8c57" exitCode=0
Sep 07 17:39:06.950037 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.949918    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"2e053e9f7960b1579d9c79fc693d4e792be8eaeb02bedd07dfa5c426d6a998cb"}
Sep 07 17:39:06.950037 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:06.949943    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"258fe0f48660e6c86240bf2c06265417c16c477509be4c2f2ebea74e1c7b8c57"}
Sep 07 17:39:08.239812 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:08.239751    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Sep 07 17:39:08.263993 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:08.263959    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Sep 07 17:39:11.346936 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:11.346897    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 07 17:39:13.350089 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:13.350045    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 07 17:39:18.239930 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:18.239875    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Sep 07 17:39:18.264043 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:18.264005    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Sep 07 17:39:21.347347 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:21.347306    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 07 17:39:23.349613 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:23.349564    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 07 17:39:28.239200 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:28.239149    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Sep 07 17:39:28.239647 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:28.239303    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:39:28.263684 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:28.263651    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Sep 07 17:39:28.263848 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:28.263786    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:39:31.347008 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:31.346959    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 07 17:39:31.347393 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:31.347084    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:39:33.349751 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:33.349705    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 07 17:39:33.350138 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:33.349846    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:39:35.859088 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.859025    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:39:35.953039 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953008    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-ui-tls\") pod \"7b87745b-0a43-4629-b336-ad3d1bbc615d\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") "
Sep 07 17:39:35.953223 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953047    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b87745b-0a43-4629-b336-ad3d1bbc615d-feast-data\") pod \"7b87745b-0a43-4629-b336-ad3d1bbc615d\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") "
Sep 07 17:39:35.953223 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953083    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9tkr\" (UniqueName: \"kubernetes.io/projected/7b87745b-0a43-4629-b336-ad3d1bbc615d-kube-api-access-r9tkr\") pod \"7b87745b-0a43-4629-b336-ad3d1bbc615d\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") "
Sep 07 17:39:35.953223 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953107    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls\") pod \"7b87745b-0a43-4629-b336-ad3d1bbc615d\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") "
Sep 07 17:39:35.953223 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953164    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-offline-tls\") pod \"7b87745b-0a43-4629-b336-ad3d1bbc615d\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") "
Sep 07 17:39:35.953223 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953197    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b87745b-0a43-4629-b336-ad3d1bbc615d-registry-tls\") pod \"7b87745b-0a43-4629-b336-ad3d1bbc615d\" (UID: \"7b87745b-0a43-4629-b336-ad3d1bbc615d\") "
Sep 07 17:39:35.953682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953655    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b87745b-0a43-4629-b336-ad3d1bbc615d-feast-data" (OuterVolumeSpecName: "feast-data") pod "7b87745b-0a43-4629-b336-ad3d1bbc615d" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:39:35.953682 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.953659    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b87745b-0a43-4629-b336-ad3d1bbc615d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b87745b-0a43-4629-b336-ad3d1bbc615d" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 17:39:35.955330 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.955305    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls" (OuterVolumeSpecName: "online-tls") pod "7b87745b-0a43-4629-b336-ad3d1bbc615d" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:35.955414 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.955334    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7b87745b-0a43-4629-b336-ad3d1bbc615d" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:35.955575 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.955558    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b87745b-0a43-4629-b336-ad3d1bbc615d-kube-api-access-r9tkr" (OuterVolumeSpecName: "kube-api-access-r9tkr") pod "7b87745b-0a43-4629-b336-ad3d1bbc615d" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d"). InnerVolumeSpecName "kube-api-access-r9tkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:39:35.955575 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:35.955559    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7b87745b-0a43-4629-b336-ad3d1bbc615d" (UID: "7b87745b-0a43-4629-b336-ad3d1bbc615d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:36.054495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.054468    2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-ui-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.054495 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.054493    2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7b87745b-0a43-4629-b336-ad3d1bbc615d-feast-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.054700 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.054508    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9tkr\" (UniqueName: \"kubernetes.io/projected/7b87745b-0a43-4629-b336-ad3d1bbc615d-kube-api-access-r9tkr\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.054700 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.054540    2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-online-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.054700 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.054552    2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7b87745b-0a43-4629-b336-ad3d1bbc615d-offline-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.054700 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.054562    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/7b87745b-0a43-4629-b336-ad3d1bbc615d-registry-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.065074 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.065040    2566 generic.go:356] "Generic (PLEG): container finished" podID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerID="9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3" exitCode=137
Sep 07 17:39:36.065206 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.065102    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"
Sep 07 17:39:36.065206 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.065123    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerDied","Data":"9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3"}
Sep 07 17:39:36.065206 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.065172    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v" event={"ID":"7b87745b-0a43-4629-b336-ad3d1bbc615d","Type":"ContainerDied","Data":"492f099e5c903f0034b913b5c154e5d3615c57e059ad06ecc6d2da6be177b7ee"}
Sep 07 17:39:36.065206 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.065200    2566 scope.go:117] "RemoveContainer" containerID="f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a"
Sep 07 17:39:36.068965 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.068932    2566 generic.go:356] "Generic (PLEG): container finished" podID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerID="7a774b22c0be22f46df67aff1708f29399e22d4e1a65df6b0a9a2e79f98718e2" exitCode=137
Sep 07 17:39:36.068965 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.068964    2566 generic.go:356] "Generic (PLEG): container finished" podID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerID="f94060c3034f5d4422b3730cccdd5e1a1afa932a50941a77838060fa80feb68b" exitCode=137
Sep 07 17:39:36.069167 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.069009    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"7a774b22c0be22f46df67aff1708f29399e22d4e1a65df6b0a9a2e79f98718e2"}
Sep 07 17:39:36.069167 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.069053    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"f94060c3034f5d4422b3730cccdd5e1a1afa932a50941a77838060fa80feb68b"}
Sep 07 17:39:36.074138 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.074123    2566 scope.go:117] "RemoveContainer" containerID="9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3"
Sep 07 17:39:36.081447 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.081430    2566 scope.go:117] "RemoveContainer" containerID="d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c"
Sep 07 17:39:36.087580 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.087560    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"]
Sep 07 17:39:36.088848 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.088830    2566 scope.go:117] "RemoveContainer" containerID="78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3"
Sep 07 17:39:36.091118 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.091098    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-jzj4v"]
Sep 07 17:39:36.096221 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.096203    2566 scope.go:117] "RemoveContainer" containerID="f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304"
Sep 07 17:39:36.103128 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103112    2566 scope.go:117] "RemoveContainer" containerID="f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a"
Sep 07 17:39:36.103394 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:39:36.103376    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a\": container with ID starting with f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a not found: ID does not exist" containerID="f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a"
Sep 07 17:39:36.103462 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103406    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a"} err="failed to get container status \"f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a\": rpc error: code = NotFound desc = could not find container \"f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a\": container with ID starting with f19a659ffc0065925b96855856964bd02e56428fbc5768acf9a93fbd448cda6a not found: ID does not exist"
Sep 07 17:39:36.103462 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103432    2566 scope.go:117] "RemoveContainer" containerID="9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3"
Sep 07 17:39:36.103685 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:39:36.103667    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3\": container with ID starting with 9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3 not found: ID does not exist" containerID="9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3"
Sep 07 17:39:36.103723 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103691    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3"} err="failed to get container status \"9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3\": rpc error: code = NotFound desc = could not find container \"9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3\": container with ID starting with 9f789d02ca2b63d35fdfa0887f3133cad1d07a5f6c5ce694dae02c64fc3176c3 not found: ID does not exist"
Sep 07 17:39:36.103723 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103705    2566 scope.go:117] "RemoveContainer" containerID="d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c"
Sep 07 17:39:36.103939 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:39:36.103924    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c\": container with ID starting with d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c not found: ID does not exist" containerID="d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c"
Sep 07 17:39:36.103978 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103941    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c"} err="failed to get container status \"d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c\": rpc error: code = NotFound desc = could not find container \"d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c\": container with ID starting with d3b9b42fb93eec942019296e40c116a2d070cd1b3365aec3a0f7226739d6d35c not found: ID does not exist"
Sep 07 17:39:36.103978 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.103953    2566 scope.go:117] "RemoveContainer" containerID="78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3"
Sep 07 17:39:36.104209 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:39:36.104190    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3\": container with ID starting with 78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3 not found: ID does not exist" containerID="78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3"
Sep 07 17:39:36.104249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.104215    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3"} err="failed to get container status \"78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3\": rpc error: code = NotFound desc = could not find container \"78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3\": container with ID starting with 78a6e712d74744b31be68884a7ffe1e9346278ef3cbc3529063493a567d28bc3 not found: ID does not exist"
Sep 07 17:39:36.104249 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.104229    2566 scope.go:117] "RemoveContainer" containerID="f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304"
Sep 07 17:39:36.104479 ip-10-0-138-5 kubenswrapper[2566]: E0907 17:39:36.104462    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304\": container with ID starting with f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304 not found: ID does not exist" containerID="f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304"
Sep 07 17:39:36.104523 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.104489    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304"} err="failed to get container status \"f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304\": rpc error: code = NotFound desc = could not find container \"f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304\": container with ID starting with f6faf60e17b224aa56984115b3f60dd9a58909fc3e13b6ec465c1d202e0c7304 not found: ID does not exist"
Sep 07 17:39:36.377137 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.377110    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:39:36.458716 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.458684    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-ui-tls\") pod \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") "
Sep 07 17:39:36.458890 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.458750    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c55e8353-c7fc-4e99-8432-a04f00bab8d8-feast-data\") pod \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") "
Sep 07 17:39:36.458890 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.458820    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkq47\" (UniqueName: \"kubernetes.io/projected/c55e8353-c7fc-4e99-8432-a04f00bab8d8-kube-api-access-nkq47\") pod \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") "
Sep 07 17:39:36.458890 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.458871    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-registry-tls\") pod \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") "
Sep 07 17:39:36.459025 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.458900    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-online-tls\") pod \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") "
Sep 07 17:39:36.459025 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.458950    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-offline-tls\") pod \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\" (UID: \"c55e8353-c7fc-4e99-8432-a04f00bab8d8\") "
Sep 07 17:39:36.459284 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.459256    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c55e8353-c7fc-4e99-8432-a04f00bab8d8-feast-data" (OuterVolumeSpecName: "feast-data") pod "c55e8353-c7fc-4e99-8432-a04f00bab8d8" (UID: "c55e8353-c7fc-4e99-8432-a04f00bab8d8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 17:39:36.460915 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.460880    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c55e8353-c7fc-4e99-8432-a04f00bab8d8" (UID: "c55e8353-c7fc-4e99-8432-a04f00bab8d8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:36.461019 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.460956    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c55e8353-c7fc-4e99-8432-a04f00bab8d8-kube-api-access-nkq47" (OuterVolumeSpecName: "kube-api-access-nkq47") pod "c55e8353-c7fc-4e99-8432-a04f00bab8d8" (UID: "c55e8353-c7fc-4e99-8432-a04f00bab8d8"). InnerVolumeSpecName "kube-api-access-nkq47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 17:39:36.461019 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.460978    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c55e8353-c7fc-4e99-8432-a04f00bab8d8" (UID: "c55e8353-c7fc-4e99-8432-a04f00bab8d8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:36.461396 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.461380    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-online-tls" (OuterVolumeSpecName: "online-tls") pod "c55e8353-c7fc-4e99-8432-a04f00bab8d8" (UID: "c55e8353-c7fc-4e99-8432-a04f00bab8d8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:36.461483 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.461468    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c55e8353-c7fc-4e99-8432-a04f00bab8d8" (UID: "c55e8353-c7fc-4e99-8432-a04f00bab8d8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 17:39:36.559582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.559506    2566 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-ui-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.559582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.559534    2566 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c55e8353-c7fc-4e99-8432-a04f00bab8d8-feast-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.559582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.559544    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkq47\" (UniqueName: \"kubernetes.io/projected/c55e8353-c7fc-4e99-8432-a04f00bab8d8-kube-api-access-nkq47\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.559582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.559553    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-registry-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.559582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.559562    2566 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-online-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.559582 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.559569    2566 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c55e8353-c7fc-4e99-8432-a04f00bab8d8-offline-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\""
Sep 07 17:39:36.771106 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:36.771074    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" path="/var/lib/kubelet/pods/7b87745b-0a43-4629-b336-ad3d1bbc615d/volumes"
Sep 07 17:39:37.075953 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.075920    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2" event={"ID":"c55e8353-c7fc-4e99-8432-a04f00bab8d8","Type":"ContainerDied","Data":"50864f2c0b568c62fb99afa4f0ed0cda7a1af8e8ff66f3958618ea54c314d437"}
Sep 07 17:39:37.075953 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.075948    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"
Sep 07 17:39:37.076497 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.075976    2566 scope.go:117] "RemoveContainer" containerID="2e053e9f7960b1579d9c79fc693d4e792be8eaeb02bedd07dfa5c426d6a998cb"
Sep 07 17:39:37.083898 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.083877    2566 scope.go:117] "RemoveContainer" containerID="7a774b22c0be22f46df67aff1708f29399e22d4e1a65df6b0a9a2e79f98718e2"
Sep 07 17:39:37.091135 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.091114    2566 scope.go:117] "RemoveContainer" containerID="258fe0f48660e6c86240bf2c06265417c16c477509be4c2f2ebea74e1c7b8c57"
Sep 07 17:39:37.096704 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.096679    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"]
Sep 07 17:39:37.098996 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.098978    2566 scope.go:117] "RemoveContainer" containerID="f94060c3034f5d4422b3730cccdd5e1a1afa932a50941a77838060fa80feb68b"
Sep 07 17:39:37.100566 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.100549    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t7th2"]
Sep 07 17:39:37.106014 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.105991    2566 scope.go:117] "RemoveContainer" containerID="1c038b38e7e3eb0a81e460384c85a5bc067311dc3b60283c572a80e7b8984c21"
Sep 07 17:39:37.113048 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:37.113031    2566 scope.go:117] "RemoveContainer" containerID="dad6fe27f6c50530f6c70fa16314d36c798f43387133b38a957dc61f81385a27"
Sep 07 17:39:38.771600 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:39:38.771569    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" path="/var/lib/kubelet/pods/c55e8353-c7fc-4e99-8432-a04f00bab8d8/volumes"
Sep 07 17:40:15.350388 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:15.350308    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7wvtk_5328ca9e-8642-4e59-a6fe-16f32fcc3c02/global-pull-secret-syncer/0.log"
Sep 07 17:40:15.568903 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:15.568869    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ww7jf_9af5a907-61fa-4bff-8db9-b8cba41d9b3a/konnectivity-agent/0.log"
Sep 07 17:40:15.618252 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:15.618146    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-5.ec2.internal_e1b5fa4acea73087691552776422cf2b/haproxy/0.log"
Sep 07 17:40:19.948568 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:19.948529    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-g7gn2_5287c3e5-6354-4fa1-a71c-a7ae364fd3ab/monitoring-plugin/0.log"
Sep 07 17:40:20.136407 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.136359    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vwc7b_01b3f66a-4583-4230-891e-451ceab7aa01/node-exporter/0.log"
Sep 07 17:40:20.154297 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.154275    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vwc7b_01b3f66a-4583-4230-891e-451ceab7aa01/kube-rbac-proxy/0.log"
Sep 07 17:40:20.174870 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.174848    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vwc7b_01b3f66a-4583-4230-891e-451ceab7aa01/init-textfile/0.log"
Sep 07 17:40:20.199244 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.199172    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7nrbs_eccf25bc-6713-41ef-8e0c-478a980ca9eb/kube-rbac-proxy-main/0.log"
Sep 07 17:40:20.225285 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.225265    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7nrbs_eccf25bc-6713-41ef-8e0c-478a980ca9eb/kube-rbac-proxy-self/0.log"
Sep 07 17:40:20.247348 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.247327    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7nrbs_eccf25bc-6713-41ef-8e0c-478a980ca9eb/openshift-state-metrics/0.log"
Sep 07 17:40:20.286109 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.286074    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/prometheus/0.log"
Sep 07 17:40:20.308592 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.308574    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/config-reloader/0.log"
Sep 07 17:40:20.332310 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.332286    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/thanos-sidecar/0.log"
Sep 07 17:40:20.352828 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.352809    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/kube-rbac-proxy-web/0.log"
Sep 07 17:40:20.373517 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.373492    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/kube-rbac-proxy/0.log"
Sep 07 17:40:20.395764 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.395741    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/kube-rbac-proxy-thanos/0.log"
Sep 07 17:40:20.416807 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.416770    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c36584fd-a5ea-4462-bb99-a6ec4587fab2/init-config-reloader/0.log"
Sep 07 17:40:20.687899 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.687871    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffc447d8f-qlbbj_ae27bfaa-f539-427c-a56a-2abd04e0a9cb/thanos-query/0.log"
Sep 07 17:40:20.713389 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.713364    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffc447d8f-qlbbj_ae27bfaa-f539-427c-a56a-2abd04e0a9cb/kube-rbac-proxy-web/0.log"
Sep 07 17:40:20.736949 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.736923    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffc447d8f-qlbbj_ae27bfaa-f539-427c-a56a-2abd04e0a9cb/kube-rbac-proxy/0.log"
Sep 07 17:40:20.761593 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.761575    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffc447d8f-qlbbj_ae27bfaa-f539-427c-a56a-2abd04e0a9cb/prom-label-proxy/0.log"
Sep 07 17:40:20.785413 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.785387    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffc447d8f-qlbbj_ae27bfaa-f539-427c-a56a-2abd04e0a9cb/kube-rbac-proxy-rules/0.log"
Sep 07 17:40:20.812333 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:20.812299    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6ffc447d8f-qlbbj_ae27bfaa-f539-427c-a56a-2abd04e0a9cb/kube-rbac-proxy-metrics/0.log"
Sep 07 17:40:22.631651 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631616    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"]
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631905    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631917    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631926    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631932    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631938    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="feast-apply"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631944    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="feast-apply"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631953    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="feast-init"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631958    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="feast-init"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631968    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="feast-init"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631974    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="feast-init"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631981    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="feast-apply"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631985    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="feast-apply"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631991    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.631997    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632004    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632010    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632017    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="offline"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632022    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="offline"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632027    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="registry"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632032    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="registry"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632037    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="offline"
Sep 07 17:40:22.632055 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632042    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="offline"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632084    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="online"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632091    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="ui"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632099    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="offline"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632105    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b87745b-0a43-4629-b336-ad3d1bbc615d" containerName="online"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632111    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="ui"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632117    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="registry"
Sep 07 17:40:22.632728 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.632122    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c55e8353-c7fc-4e99-8432-a04f00bab8d8" containerName="offline"
Sep 07 17:40:22.634461 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.634445    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.637205 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.637179    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mvt4j\"/\"default-dockercfg-8v5b4\""
Sep 07 17:40:22.637332 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.637189    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvt4j\"/\"kube-root-ca.crt\""
Sep 07 17:40:22.638171 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.638151    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvt4j\"/\"openshift-service-ca.crt\""
Sep 07 17:40:22.645269 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.645248    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"]
Sep 07 17:40:22.701786 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.701746    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-lib-modules\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.701786 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.701784    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-proc\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.702002 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.701822    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-sys\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.702002 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.701844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-podres\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.702002 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.701861    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czcbf\" (UniqueName: \"kubernetes.io/projected/cc437213-def8-44f9-a534-e5c68198e0d4-kube-api-access-czcbf\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803020 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.802977    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-sys\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-podres\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czcbf\" (UniqueName: \"kubernetes.io/projected/cc437213-def8-44f9-a534-e5c68198e0d4-kube-api-access-czcbf\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803106    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-sys\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-lib-modules\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803157    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-proc\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803213 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-podres\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803458 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803225    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-proc\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.803458 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.803295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc437213-def8-44f9-a534-e5c68198e0d4-lib-modules\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.811199 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.811179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czcbf\" (UniqueName: \"kubernetes.io/projected/cc437213-def8-44f9-a534-e5c68198e0d4-kube-api-access-czcbf\") pod \"perf-node-gather-daemonset-x66ml\" (UID: \"cc437213-def8-44f9-a534-e5c68198e0d4\") " pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:22.859789 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.859757    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-cnbd7_287dea2b-f601-4b31-986e-2ee578804616/download-server/0.log"
Sep 07 17:40:22.944368 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:22.944274    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:23.213964 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:23.213875    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"]
Sep 07 17:40:23.216756 ip-10-0-138-5 kubenswrapper[2566]: W0907 17:40:23.216717    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc437213_def8_44f9_a534_e5c68198e0d4.slice/crio-47e291431aaaf2eb717764fd60f366a8759d8d0e98a5cad87031f60861869b7c WatchSource:0}: Error finding container 47e291431aaaf2eb717764fd60f366a8759d8d0e98a5cad87031f60861869b7c: Status 404 returned error can't find the container with id 47e291431aaaf2eb717764fd60f366a8759d8d0e98a5cad87031f60861869b7c
Sep 07 17:40:23.245764 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:23.245718    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml" event={"ID":"cc437213-def8-44f9-a534-e5c68198e0d4","Type":"ContainerStarted","Data":"47e291431aaaf2eb717764fd60f366a8759d8d0e98a5cad87031f60861869b7c"}
Sep 07 17:40:24.186972 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.186942    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lbn8b_9e548326-1231-4411-b8a2-31eb5f78f97f/dns/0.log"
Sep 07 17:40:24.206293 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.206266    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lbn8b_9e548326-1231-4411-b8a2-31eb5f78f97f/kube-rbac-proxy/0.log"
Sep 07 17:40:24.228676 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.228648    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-28qbv_e45a50fa-ca6f-4298-9807-9964c6ae62a3/dns-node-resolver/0.log"
Sep 07 17:40:24.250357 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.250322    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml" event={"ID":"cc437213-def8-44f9-a534-e5c68198e0d4","Type":"ContainerStarted","Data":"afa2d97fd0c1d68a954ca592dede283ee456124b69bbac4c22f9bd2b30f3f185"}
Sep 07 17:40:24.250530 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.250452    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:24.266332 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.266288    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml" podStartSLOduration=2.26627459 podStartE2EDuration="2.26627459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 17:40:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 17:40:24.265039644 +0000 UTC m=+1910.001848056" watchObservedRunningTime="2026-09-07 17:40:24.26627459 +0000 UTC m=+1910.003083034"
Sep 07 17:40:24.668515 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.668481    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78bfb96ddb-2cnl4_e0d9fc8f-b31e-47f4-82da-57edd42e1e7b/registry/0.log"
Sep 07 17:40:24.732695 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:24.732639    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tnsjj_4d9b6049-4fb2-4c3f-b9f3-31e2069cc55d/node-ca/0.log"
Sep 07 17:40:25.747347 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:25.747312    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tdvlb_a223c599-943b-426d-8a68-f22abe23b63b/serve-healthcheck-canary/0.log"
Sep 07 17:40:26.104685 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:26.104656    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ff96_6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2/kube-rbac-proxy/0.log"
Sep 07 17:40:26.127231 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:26.127196    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ff96_6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2/exporter/0.log"
Sep 07 17:40:26.151183 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:26.151149    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7ff96_6ed84d6b-30f2-4bcc-9a99-cbbb0f43edc2/extractor/0.log"
Sep 07 17:40:30.263299 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:30.263274    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mvt4j/perf-node-gather-daemonset-x66ml"
Sep 07 17:40:30.303832 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:30.303802    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-5vzsq_8effc74a-e4e8-4d3f-92ce-8ac6dbae7486/migrator/0.log"
Sep 07 17:40:30.322312 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:30.322285    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-5vzsq_8effc74a-e4e8-4d3f-92ce-8ac6dbae7486/graceful-termination/0.log"
Sep 07 17:40:31.917467 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:31.917441    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/kube-multus-additional-cni-plugins/0.log"
Sep 07 17:40:31.942398 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:31.942376    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/egress-router-binary-copy/0.log"
Sep 07 17:40:31.968840 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:31.968818    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/cni-plugins/0.log"
Sep 07 17:40:31.992698 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:31.992664    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/bond-cni-plugin/0.log"
Sep 07 17:40:32.017109 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:32.017090    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/routeoverride-cni/0.log"
Sep 07 17:40:32.039385 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:32.039355    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/whereabouts-cni-bincopy/0.log"
Sep 07 17:40:32.061790 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:32.061768    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sgvmz_2e4de1cd-2af1-4d98-be48-9713f59c41d6/whereabouts-cni/0.log"
Sep 07 17:40:32.125807 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:32.125778    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wjhtl_78dade0d-191e-411d-822b-e420615d648e/kube-multus/0.log"
Sep 07 17:40:32.193860 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:32.193768    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84kp7_2736a459-1c6a-4d22-88da-e56f248f4c09/network-metrics-daemon/0.log"
Sep 07 17:40:32.214171 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:32.214138    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84kp7_2736a459-1c6a-4d22-88da-e56f248f4c09/kube-rbac-proxy/0.log"
Sep 07 17:40:33.329376 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.329345    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/ovn-controller/0.log"
Sep 07 17:40:33.345156 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.345123    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/ovn-acl-logging/0.log"
Sep 07 17:40:33.376716 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.376646    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/kube-rbac-proxy-node/0.log"
Sep 07 17:40:33.397329 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.397307    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/kube-rbac-proxy-ovn-metrics/0.log"
Sep 07 17:40:33.414778 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.414754    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/northd/0.log"
Sep 07 17:40:33.437009 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.436983    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/nbdb/0.log"
Sep 07 17:40:33.458927 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.458896    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/sbdb/0.log"
Sep 07 17:40:33.509307 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:33.509278    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q5vrn_67260cc8-cddb-49f8-beda-24d582982b53/ovnkube-controller/0.log"
Sep 07 17:40:34.685084 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:34.685036    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ktvgz_604b5a48-4e6e-4f47-8d12-58f6eb58e9a2/network-check-target-container/0.log"
Sep 07 17:40:35.579145 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:35.579096    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hs8fc_22ce17bd-3a00-409e-8faf-06c0e0568ba5/iptables-alerter/0.log"
Sep 07 17:40:36.226192 ip-10-0-138-5 kubenswrapper[2566]: I0907 17:40:36.226162    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-j8w5l_8cd4e148-ac61-48fa-926b-d62caac17041/tuned/0.log"